D0CD8BIT BESDHE 



ED 123 135 

AOTHOB, 
TITLE 

mSTITUTION 

POB DATE 
NOTE 

iVillABlE FEOTI 



EDBS PEICE 
DESCRIPTORS 



SE 020 964 

Helgeson, Stanley 1*, Ed*; Blosser, Patricia E#, 
Ed. 

Investigatioiis in science Education, Vol* 1, Ko* <t* 
Expanded Abstracts and Critical Analyses of Recent 
Research* 

Ohio State Univ*, Colusbus* Center for Science and 

Mathematics Education. 

75 

70p* 

Ohio State university. Center for science and 
nathenatics Education, 244 Arps Hall, Columbus, Ohio 
43210 (Subscription $6*00, $1*75 single copy) 

(!F*$0*83 HC*$3*50 Plus Postage* 
^Abstracts; Cognitive Development ; ^Educational 
Research; Instruction; Research; Researchers; 
♦Research Kethodology; ♦Research Skills; ♦science 
Education; Teacher Education 



ABSTRACT 

This fourth issue of 
EDaCATION (ISE), designed to provide 
research articles and to aid in the i 
reports, includes abstracts prepared 
bibliographical data, the research de 
investigators including data, purpose 
as veil as detailed notes offered by 
ISE are selected primarily from such 
and reports of goirernment*f unded proj 
inaugurates the so*called Cluster Rev 
together according to common concern* 
analyzed in this issue are: Instructi 
Education, and Cognitive Development* 



INVESTIGATIONS IN SCIENCE 

a new perspective for viewing 

mproveoent of writing research 

by science educators, 

sign and procedure used by the 

, and rationale of tJie research, 

the abstractor* Articles in the 

sources as professional journals 

ects* ffith this issue, ISE 

iews* These are reviews grouped 

Four clusters of studies 
on, student Attitudes, Teacher 

(Author/EB) 



♦ Documents acquired by EfilC include many informal unpublished ♦ 

♦ materials not available from other sources* ERIC nalces every effort 

♦ to obtain the best copy available* Nevertheless, items of marginal 

♦ reproducibility are often encountered and this affects the quality 

♦ of the microfiche and hardcopy reproductions E^ilC makes available 

♦ via the ERIC Document Reproduction Service (EDBS) EDES is not 

♦ responsible for the quality of the original document* Reproductions 

♦ supplied by EDBS are the best that can be made from the original* 



ERIC 



Vol. 1, No. 4 1974-75 




U S OE^AtrMtNTOF HEALTH. 
EDUCATlOtf ^WELFAte 

NAr^oNAL fHsnruTE of 

EDUCATION 

IHIS OOCUaaENT has seen REP(?1> 
DUCEP E;(ACTLr AS RECEIVED fVtOM 
THE PERSON OR ORGANIZATION ORlOlN^ 
ATlWCtT POtWTS OF VIEW OR OPINIONS 
STATED 00 NOT NeCESSARlLY REPRE- 
SENT OFFICIAL NATIONAL INSTITUTE OF 
EDUCATION POSITION OR POLICT 



TIGATIONS 
E 

TION 



Expanded Abstracts 
and 

Critical Analyses 
of 

Recent Research 



or* 



National Association fw Res«arch in Science Teaching 

ERIC Science. IMathematicsi and Environmental 
Education Information Analysis Center 

The Center for Science and IMattiematics Education 
The Ohio State University 



ERIC 



INVI^STIGATIONS IN SCIENCE EDUCATION 



Editor 

Stanley L* Helgescn 
Hie Ohio State University 



Associate Editor 

Patricia E, Blosser 
The Ohio State University 



Advisory Board 



Mary Budd Rowe 
University of Florida 

Robert G, Bridgham 
Michigan State University 



David P, Butts 
University of Georgia 

Joseph D.. Novak 
Cornell University 



Vincent N* Lunetta 
University of Iowa 



National Association for Research in Science Teaching 

ERIC Center for Science, Mathematics ^ and 
Environmental Education 



Published Quarterly by 

Center for Science and Mathematics Education 
College of Education 
The Ohio State University 
North High Street 
Cylambus , Ohio ^3210 



Subscription Price: $6,00 per year. Single Copy Price; $1,75 
Add 25C for Canadian mailings and 50C for foreign mailings. 



ERIC 



3 



INVESTIGATIONS IN SCIENCE EDUCATION 



Vo] . 1, No* 4, 1974-75 

NOTES from zhe editor * ill 

INSTRUCTION 

Callagherj James Josepli, "A Comparison of Individualized 
and Croup Instruction In Science; Effects on Third 
Gr^ide Pupil.fi/^ Journal of Research in Science 
Te^tMn^, Vol* 7, No* 3:253-263, 1970* 

Abstracted by JULIAN R* BRAWDOU 2 



Olsen, Robert Chiirles, '*A Comparative Study of the Effect 
of Behavioral Objectives on Class Performance and 
Retention in Physical Science**' Journal of Research 
In Science Teachina , Vol. 10* No* 3:271-277* 1973* 

Abstracted by RUSSELL H. YEAN^, JR 



Talieyt Lawerence H** "The Use of Three-Dimensional 

Visualization as a Moderator in the Higher Cognitive 
Learning of Concepts in College Level Chemistry*'* 
Journal of Research in Science Teaching ^ Vol* 10, 
No* 3:263-269, 1973. 

Abstracted by MILTON 0* PELLA 9 

STUDENT ATTITUDES 

Milson, James L* , '^The Development and Evaluation of 

Physical Science Curriculum Materials Designed to 
Improve Student Attitudes*" JourT^al of Research in 
Science Teaching , Vol* 9, No* 4:2S9'-304, 1972* 

Abstracted by JOHN T* WILSON 1^ 

Schwirian, Patricia M, and Barbara Thomson, "Changing 
Attitudes Toward Science: Undergraduates in 1967 
and 1971*^' Journal of Research in Science Teaching , 
Vot. 9, [^o* 3:253-259, 1972* 

Abstracted by RONALD D* SIMPSON 19 

Simpson, Ronald D* , John W* Shrum and R* Robert Rentz, 
'^The Science Support Scale: Its Appropriateness 
with High School Students*'^ Journal of Research 
In Science Teaching , Vol* 9, Ho- 2:123*126* 1972* 

Abstracted by ROBERT L* STEIWER 23^ 

TEACHER EDUCATION 

Merkle^ Dale , *'A Leadership Workshop on Elementary 
School Science; An In-Dept Evaluation**' Journal 
of Research in Science Teaching , Vol* 7^ No* 2: 
121-133, 1970* 

Abstracted by WILLIAM S, LASHIER, JR 30 
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Roberts, Richard A. and Jacob W. Blankenship, "The 

Relationship Between the Change In Pupil Control 
Ideology of Student Teachers and the Student 
Teacher's Perception of the Cooperating Teacher's 
Pupil Control Ideology.** Journal of Research In 
Science Teaching , Vol. 7, Uo. 4:315-320, 1970. 

Abstracted by VINCENT LUNETTA 35 

COGNITIVE DEVELOPMENT 

Allen, Leslie , "An Examination of the Ability of 

Third Grade Children from the Science Curriculum 
Improvement Study to Identify Experimental Vari- 
ables and to Recognize Change." Science Education , 
Vol. 57, No. 2:135-151, April/June, 1973. 

Abstracted by JULIAU R. BRAKDOU ^2 

Nicodemus, Robert B. , *'Content and Skill Hierarchies in 

Elementary Science: An Analysis of ESS Small Things." 
Journal of Research in Science Teaching , Vol. 1, 
No. 3:173-177, 1970. 

Abstracted by DONALD E. RIECHARD ^5 

Raven, Ronald J., "The Development of the Concept of 
Acceleration in Elementary School Children/* 
Journal of Research in Science Teaching , Vol. 9, 
No. 3:201-206, 1972. 

Abstracted by DAVID K. OST 50 

Raven, Ronald J., "The Effects of a Structured Learning 
Sequence on Second and Third Grade Children's 
Classification Achievement-" Journal of Research 
in Science Teaching . Vol. 7, No. 2:153-160, 1970. 

Abstracted by ANN C HOWE 55 

Allen, Leslie R- , "An Evaluation of Certain Cognitive 

Aspects of the Material Objects Unit of the Science 
Curriculum Imptoveinent Study Elementary Science 
Program." Journal of Research in Science Teaching , 
Vol. 7, No. 4:277-281, , 970. 

Abstracted by CHESTER E. RAUN 59 
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NOTES 



from the Editor 



With this issue^ Investigations in Science Education inaugurates 
the *'Clu3tet Reviews'* announced in the last issue* These are reviews 
grouped together according to conmion concerns* Jour clusters of 
studies are anal/zed in this issue: Instruction^ Student At titudes > 
Teacher Education* and Cognitive Development* The analysts have 
attempted^ where appropriate, to consider related research in their 
critiques of the reported studies* By presenting such clusters* it 
is intended that a broader> more comprehensive view of the current 
state of research in science education can be presented* 

Comments and suggestions for improving Investigations in Science 
Education are invited and publishable letters of response to the 
abstracts and analyses are encouraged* 

Stanley L* Helgeson 
Editor 

Patricia E* Blosser 
Associate Editor 
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Gallagher^ James Joseph* Comparison of Individualized and Group 

Instruction In Science; Effects on Third Grade Pupils," Journal 
of Research In Science Teaching , Vol, 7, No, 3:253-263, THO, 
Descriptors— Academic Achievement, Audiovisual Instruc tion, 
^Elementary School Science, ^Evaluation Techniques, Grade 3, 
*Individualized Instruction, *lnstruction. Science Activities 

Expanded Abstract and Analysis Prepared Especially for I,S,E, by 
Julian E, Brandou, Michigan State University, 



Purpose 

The purpose of the study was to compare the achievement and per- 
formance during instruction of groups of third grade students in two 
modes of instruction and a combination of the two. The two modes were 
audio- tutorial (A-T) and teacher-directed (T-D) , 

Hypothesis 1: (deals with performance) 

A-T will be distracted less than T-D, 

Hypothesis 2: (deals with achievement) 

A-T will be greater than T-D as measured by: 

a, definition of "Interaction" 

b * generalization across examples 

c. identification of exemplars/non-exemplars 

d, description by Identifying interacting dyads 



Rationale 

The author notes that most contemporary elementary school science 
programs depend on pupil exploration or Independent investigation of 
materials and phenomena at the outset of Instruction, This follows 
from the assumption that these "conmon, first-hand experiences provide 
sensory Input that Is essential for meaningful learning,'* 

Further, he suspects that the typical classroom serting may pro- 
vide too much distraction for the pupil to effectively receive the 
necessary Inputs. Previous research by Novak, Bridgham, Hill and 
Sieraankowskl is cited on audio- tutorial instruction. 



Research Design and Procedure 

The basic design is a posttest only applied to four randomly 
assigned treatment groups. 

Sixty third grade pupils from a public school in a middle class 
suburban commonity were randomly assigned to four groups. Group one 
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was given a two lesson audio-tutorial sequence; group two received the 
same lessons* teacher-directed; group three was given the first lesson 
via A-T and tha second* teacher-directed; and group four received no 
instruction oi^ the topic*^ Lesson one was an "exploration" from the 
Science Curriculum Iinprovenient Study* Interaction unit, and lesson two 
was the subst'quent "'invention*' lesson*. The Iowa Teat of Basic Skill 
was used to show that groups were similar and the school program already 
involved sorae Individualized work in reading and mathematics. The 
author assumed the A-T was* thus, not a novelty.. 

On Hypothesis 1; Videotapes of the pupils were analyzed to deter- 
mine '*overt distraction." Five characteristic activities are dis- 
cussed and the mean percentage of time* to the nearest tenth of a per-^ 
cent, ig given*. 

On Hypothesis 2: A special test was developed consisting of items 
such as the following: 

1> Tell what interaction ig . 

2*. How do you know when interaction takes place? 

3, Pictures of exemplars; (four items) and non-exemplars (one 
item) and the student was asked, "Does the picture show 
interaction?" 

Response categories were created* and the number of responses in 
each category for each item was reported. Since the posttest was 
delayed to one week after the instruction and only two lessons were 
involved, the duration of the study was probably two ^eeks at most.. 

Summary data were presented for each Item and for the four exemplar 
pictures as a group. These Items were scored by total number of cor- 
rect responses since the pupil could frequently describe more than 
on^i dyad of interaction for each picture. 



Findinfig 

1, Students taught by A-T were less distracted than those 
taught by the teacher-directed method*. 

1. Students taught by the combination of lessons did better 
on the definition of Interaction > 

3. Students taught by A-T did >etter on generalization across 
several examples^ 

4. Students taught by either method were able to discriminate 
between exemplars and non-exemplars t Irrespective of method.. 

5. Students taught by a teacher part or all (both) of the 
timeCa) identified dyads more frequently than those 
Ins true t^id by A-T, 
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Intarpretaclons 



In a section titled ''Discussion*" the author emphasises the 
relationship between the reduced distraction and the increased ability 
to generalise about the examples. He concludes that instructional 
mode selection should be done In relation to the outcofmes desired and 
Che relative effectiveness of the several available modes. 



ABSTRACTOR'S ANALYSIS 

Studies on the relattonahip of a variety of modes of instruction 
to a given set of conditions are likely to be as difficult to design 
as they are Important, Wouldn't it be neat to describe the class* 
teacher* setting* social context and related variables and then, £or 
a given outcome* to be able to select the most efficient^ moat pemanentr 
or most whatever mode for the Instruction? Unfortunately this study 
compounds the problem with only two lessons involved by choosing two 
quite different elements in the sequence , A variety of modes on 
''exploration'' or ''invention"* might have be i more productive, Nonethe- 
lesSj the two selected^ A-T and Teacher-a. ected* do show some benefit 
from personal observation time , especially where this time can be 
followed by a sharing and reshaping of these observations. This brings 
us into the whole realm of aequencing instruction to include not only 
contents and activities but modes of instruction as well. 

The atudy seems well done and the author did not leap beyond his 
data. The written report is most adequate and the inclusion of the 
test as appendix a most welcome aapect. Of course* one would like 
more pupils, more leasons and» thus* more opportunity to generalise. 
Perhaps* the same results would show anyway on these carefully limited 
questions , 
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Oisen* Robert Charles* '*A Comparative Study of the Effect of Behavioral 
Objectives on Class Performance Retention In Physical Science*" 
Journal of Research in Science Teaching t Vol. 10* No* 3:271-277, 
1973. 

Descriptors — ^Academic Achievement* ^Behavioral Objectives* 
Educational Research* *Grovjp Instructionj Instruction* 
^Physical Sciences* Stience Education, Secondary Grades* 
^Teaching Procedures 

Expanded Abstract and Analysis Prepared Especially for I*S*E* by 
Russell Yeany* Jr., University of Georgia* 



Purpose 

This study was conducted to compare the achievement and learning 
retention of ninth grade physical science classes receiving instruction 
with a prior knowledge of the behaviorally stated objectives to equiva- 
lent classes taught the same material without prior knowledge of the 
objec tlves * 



Rationale 

During the last decade, new classroom materials and different 
methods of instruction have been investigated in attempts to increase 
learning effectiveness* One method of Instruction which has received 
attention from science educators Is the behavioral approach to learn- 
ing* While advocates of behaviorally stated objectives have called 
for curriculum development using measurable objectives and the litera" 
ture suggests many ways to utilize these objectives^ the researcher 
believed that research on the effectiveness of using behavioral objet^ 
tives In itistructlon is far from complete- 
No underlying assumptions about the relationship of the treatment 
to psychological theories on previous research were stated* 

Research Design and Procedure 

Fourteen ninth grade physical science classes from two junior 
high schools in Ridgewood* New Jersey, were Included in the study* 
With subjects in pre-assembled classes it was necessary to randomly 
assign intact classes to the two treatments* 

The S^ettuential Test of Educational Progress was used to measure 
the entering performance of all subjects prior to the start of the 
experimental study* Pre-experimental data were also collected with 
the Otis-Lennon Mental Ability Test , Form J . 

Eighteen behavioral objectives and 36 assessment tasks were con* 
structured by the researcher and reviewed by a panel of science 
educators* A list of the action verbs used are included in the 
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published report*. The behavioral objectives for each of four chapters 
ware given to the experimental classes^ one chapter at a time.. The 
assessment taslcs^ although not well defined » were provided to insure 
a more complete esqiosure and reinforcement for each objective*. 

The control classes did not receive the objectives but it was 
not made clear by the researcher whether they ^j^sed the taslt assess- 
ment* The inference is that » since the tasks were objective specific^ 
they probably did not*. 

At the conclusion of the three month treatment period^ the 
Interaction of Hatter and Energy (IME) » also the text which was used^ 
unit achievement test was administered to all classes*. Three weeks 
later t the IME final test was administered and those items appropri- 
ate to the experimental objectives were analyzed* 

The study can be diagrammed in the Campbell and Stanley notation 
as follows: 




* random assignment was made at the classroom level 

Analysis of covariance was used to test the effect of treatment 
on science achievement and retention of the ninth grade students* 
Initial scores on the STEP and Otis-Lennon IQ scores were used as 
covariates In the analyses*. 



Jtndings 

Use ot the ANCOVA procedures indicated the experimental group 
obtained higher adjusted mean scores than the control group in both 
achievement and retention (p^ *00X) *. 



tnterpreta tlons 

The author bellived that the results of the study support the 
thesis that , providing classes and teachers with behavioral objectives 
prior to instruction can enhance the performance on achievement tests* 
kl90^ the data suggest that the objectives and their accompanying 
assessment tasks will cause a resistaiice to forgetting* 

ABSTRACTOR'S ANALYSIS 

It may seem to be obvious that if a student has access to the 
Instructional objectives learning will be facilitated* Study time 
should be more task oriented and the student should be better able 
to gauge his progress in relation to the objectives*. But^ the research 
does not always support the above assumption* 
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Prom an examinacion of 39 different studies it can be calculated 
that approximately 60 percent shoved no significant difference in 
achievemeni: when behavioral objectives were given to students and/or 
teachers. The age of the subjects in these studies ranged from fifth 
grade through college and covered a variety of content areas.. The 
evidence is contradictory to say the least.. 

One dimension lacking in much of the research on the use of 
objectives is pointed out by a failure to look at a full range of 
student variables in order to ferret out the type of student who 
would benefit most from access to the objectives.. 

In the present study, Olsen may have Indirectly Identified on<i 
such variable.. The average IQ of his sample can be calculated to be 
approximately 113, which is one full standard deviation above the 
mean of the population of all ninth graders. Whether these results 
are generalizable across all IQ levels is a question that will go 
unanswered because the researcher chose to use the variable as a 
covariate rather than a main factor in the design. 

An effort must also be made to sort out the multiple treatment 
effects that tend to combine when a specific variable is being 
researched.. For example, the investigator was researching i]ot only 
the effects of providing behavioral objectives but also the use of 
assessment tasks.. In order to examine their singular influence, two 
more treatment levels ere called for (i.e., one gtoup receiving only 
objectives and one group, only the assessment tasks). 

The teacher dimension should never be Ignored in any research 
related to instructional proceedings. Not enough is known about the 
teachers in this report. Were all teachers using both methods? 
Random assignment of teachers to treatment levels is usually a very 
sound decision. Bur, the fully crossed design with teachers as a 
factor, where it is possible, does allow one to look for the possible 
interaction between teacher variables and the method of instruction. 

The study should be considered as a bri^t spot in the search 
for effective uses of behaviorally stated objectives. And, it pro^ 
vides another link in the matrix of research on the subject but 
does not resolve the issue. 

Future research is needed to look at related factors such bs\ 

(1) the student entrance characteristics of mental abilit> , attitude 
toward school, personality type end previous success in school, 

(2) teacher's attitude toward structure and level of familiarity with 
the use of behavioral objectives, and (3) a whole host of environ- 
mental factors Including the nature of the content, the taxonomlc 
level of the objectives and the presence or absence of other instruc- 
tion techniques. All of the above may in some way be related to the 
results of any instructional strategy and can therefore not be 
ignored when the effects of using behavioral objectives are being 
examined. The research must move beyond the two treatment group 
stag^ where all these variables are allowed to be random but 
unaccounted for . 
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Research on instruction should also look beyond the cognitive 
domain.. If the method promotes cognitive growth at the expense of 
attitude toward instruction or the content^ what have we gained? 
Or» if there are no significant differences in achievement with gains 
in attitude » are ve not ahead? 
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Talley* Lawerence H.^ *'Ths Use of Three-Bimensional Visualization as 
^ Moderator in the Higher Cognitive Learning of Concepts in 
College Level Chemistry." Joarnal of Research In Science Teach- 
inR > Vol, 10* No. 3:263-269* 1973, 



Descriptors — ^Academic Achievementt ^Chemistry* College 
Sciencfit Critical Thinking* ^Educational Research^ ^instruction* 
^Instructional Media^ Science Education, Visual Aids 



Expanded Abstract and Analysis Prepared Especially for I,S.E. by 
Milton 0. Pella* University of Wisconsin. 



The problem was: Will cognitive learning of concepts in college 
level chemistry be moderated by training in three dimensional vis- 
ualization? 

Null hypothesis; There ifi no significant difference between 
the formative test score means of a class of students who 
receive instruction wsing visualization as a moderator in 
cognitive learning of cheiois^^y and a class of students who 
receive instruction using a didactic approach in learning 
chemical concepts. 



Rationa_le 

The underlying rationale is that learning is assumed to be a 
function of cognitive-perceptual factors, therefore* higher cognitive 
learning of chemical interaction is related to three dimensional 
visualization and this is moderated by manipulating concrete models. 



Research Design and Procedurfe 

Experimental design — Comparative groups were formed from a 
total population of 102 college freshmen enrolled in chemistry. The 
class was divided into two groups and one was randomly selected as 
experimental . 

Three dimensional ability was measured with Paper Folding Test 
V3-2 and Surface I>evelopment Test V3-3 by L, L, Thurston, The 
covariants were the scores on the combination of the Thurston Tests^ 
ACT Science Reading^ and ACT Mathematics tests. 

Experimental factor — One class was taught using individual 
molecular model kits from which three dimensional models of chemical 
species and interactions wre contructed following the instructions 
of the teacher after the species or interaction had been discussed 
by the teacher. 



Purpose 
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The second class received teacher descriptions but did aot use 
models. Essentially the presence or absence of models was the experi 
mental factor, however, the problem relates to training in three 
dimensional visualizatioti. 

At the conclusion of each unit of the course formative tests of 
50 items (15 analogy, 10 knowledge, 10 comprehension, 5 application, 
5 analysis, 5 evaluation; were administered to both groups* Test 
reliabilities were (KH'2J) 0,75 to 0*88, 



Findings 

1- Experimental group hsd significant pre-post test gsins 
on Thurston instruments, 

2, Control group achieved significantly higher scores than 
the experimental group on knowledge items* 

3* Experimental group achieved significantly higher scores 
than the control on higher cognitive level items, 

4* There was no significant difference between groups on 
comprehension level items. 



Interpre ta tions 

1* Learning is a function of cognitive perceptual factors. 

2, Mull hypothesis is rejected* 

3, Use of models result^^ in greater achievement in freshman 
college chemis t ry , 

4, Students with greater experience in visualization score 
significantly higher on application, analysis, evalua'^ 
tion, and analogy subtests* 

5, Students who are not experienced in visualization 
perform at essentially t\e lower levels of knowledge 
and comprehension, and such performance at these levels 
has a destructive effect on achievement ^t higher 
cognitive levels, 

ABSTItACTOR'S ANALYSIS 

The total population of 102 students was used in the experiment 
so the population does not represent a larger population and the use 
of probability statistics is not proper. The calculations of signlfi 
cant differences are not possible when samples are not used. The 
only randomization employed was the selection of one half of the 102 
to be experimental. 
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The study lacks specificity; are concepts defined as per the 
educational psychologists or the scientists? (See Hcmple - Philosophy 
of Natural Science .) Is the knowledge content that makes up the 
cognitive domain empirical, theoretical, or both (molecular models 
are theoretical); is the content classif icatory or correlational; is 
the content qualitative, comparative, or quantitative? 

Because of the lack of specificity of definition and description 
in tenns of objectives and evaluation, the study does one thing: helps 
us to see the need for more precise problem statements* ite.» the 
relative effectiveness of verbal-pictorial and three dimensional 
analogous models in teaching a concept of compound as (a) the union of 
two or taore elements, or (b) a homogenous substance composed of two 
or more elements present in definite proportions^ or (c) "a substance 
made up of two or more atoms," or (d) "a substance made up of two or 
more ions," etc* Kote that a and are empirical; a is descriptive 
and b is quantitative and c and d are theoretical* c is more primitive 
than d. It is obvious that there many concepts and laws in 
chemistry for which there is no application of molecular models as 
per those possible through the kits* The content of chemistry is 
not homogenous in terms of type or complexity as assumed in this 
paper. 

The author exceeded the bounds established in the statement of 
the problem by his inferences and also by improper use of probability 
statistics.. Kote aIso» if the statistical treatment were proper, 
that the fact that F ratios vary in magnitude does not mean that 
those with the larger F are more significant* The existence of 
significance also does not indicate a cause ^d effect relationship* 
In the study it is stated — the teaching methodology was a primary 
factor in the greater achievement.. 

References are made to "changing ways of thinking and * critical 
thinking**" These were not r'srt '^f the problem and are not reason^ 
Able inferences even if we knew what the terms meant. 

This type of research is extremely valuable.. However, there is 
serious need for greater precision.. The results of this study merely 
indicate that somewhere in the chemistry content covered here the use 
of three dimensional models worked better than the other approach. 
It kind of misses the mark of saying those who possess ability in 
three dimensional perception learn more ^*chemistry*^ when models are 
used than those with a physical deficiency in three dimensional per- 
ception* The problem includes the factor ''by training in three 
dimensional visuali2ation'^ yet there is no evidence of training 
other than using the model kit* 

This study fails to meet the criterion of generalizabillty 
because the population may not be assumed to represent any population 
beyond the 102 used* 
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Mllson^ James L,t '*The Development and Evaluation of Physical Science 
Curriculma Materials Designed to Improve Student Attitudes*." 
Journal of Research in Science TeachlnR , Vol. 9^ Wo. 4:289-304^ 
1972. 

Descriptors — *Attltudes> Curriculxim^ ^Curriculum Development^ 
^Curriculum Evalaationj ^Educational Research » Intelligence, 
Physical Sciences J Secondary School Science » * Slow Learners 

Expanded Abstract and Analysis Prepared Especially for I,S,E, by 
John T. Wilsoiaj The University of Iowa, 



Purpose 

The investigator intended to develop and evaluate physical sci- 
ence materials that were suitable for producing positive attitudes 
toward science instruction when used with below average secondary 
school students (referred to henceforth as lower ability students). 
The development of the materials was to be guided by characteristics 
of lower ability students as identified through a survey of the 
literature 



Ra tionale 

Characteristics of lower ability students^ as summarized from 
empirical descriptions j did not reflect any particular conceptual 
framework. Factors such as low IQ (75-90) » reading difficulty^ 
problems In abstraction^ association^ and generalizing were cited. 
While many frameworks exist in the literature linking these factors 
to instruction^ none were cited* 

Although not explicitly stated as suchj the study assumed that a 
strong link exists between student interest^ personalityj and aca- 
demic performance. The implication was that if school situations 
were changed* the attitude of the student would also change. These 
changes shouldj if the conjectures were correctj poi^itively influence 
academic performance. 



Research Design and Procedure 

The two phases of the atudy were described separately. Phase 
one was concerned with the guidelines and development of materials 
for lower ability students and phase two^ with the evaluation of 
these materials. During phase one^ an elaborate set of guidelines 
was presented. How they were derived from the characteristics of 
lower ability students was not described. Specific information about 
the materials utilized and their evaluation in the study was not 
givenj only general information was stated^ whicK claimed that the 
"materials conformed to the guidelines," No other specific informa- 
tion about any particularly activityj les&on material, or teacher's 
classroom performance — expected or observed — was reported. 
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During th^ evaluation phase of the study, one set of materials 
concerned with the study ,if heat and temperature was utilized. Nine 
experlmeats and five reading assignments were involved. The specific 
natures of experiments and reading asslgtUDents t^re not described. 
The design utilized was Identified ^s a "n one qulva lent control group 
design*" No random assignment of students to groups waa made; Instead, 
Intact a roups > as constructed by the school, were assigned to experi- 
mental or control status. (The ii used In the analysis was the number 
of students). Out of the six lower ability classes^ three were assigned 
to the experimental group and three to the control group. (This 
description here may be let error slnce^ from the study, It was diffi- 
cult to determine who was assigned to what). By chance, two teachers 
taught the three experimental classes and two taught the control 
classes. It was carefully pointed out that no teacher taught both 
types of classes — experimental and control. Evidently the classes 
must have been small since the total number of students reported In 
the experimental group was only 23 and In the control group, 26. No 
coimnents were made about high attrition rate during the several weeks 
the study took place. The students were mostly ninth and some tenth 
grade high school students. 

Before and after their participation In the sample unit on Heat 
acid Temperature^ the students were given some form of Osgood's 
Semantic Dlf f erentlal. Five concept areas were assessed: science 
classes (sc) » science laboratory (si) » science teacher (st) , the 
school Cs), and specific science topic (c) - The specific set of 
adjectives used f'^t' each of these concept areas was not reported nor 
was the procedure described as to how the "factor scores" were cal- 
culated> Some simple arithmetic suggests that the scores were raw 
sunmatlve scale scores where the responses of the students, which 
probably varied from one to seven, were simply added. High scores 
were hence indicators of positive attitudes and low scores, negative 
ones> Hot^ever, this procedure is only this revlewer^s assumption. 

Analysis of data Included ANOVA to test pre-to-post differences 
within the experimental group and within the control group. Between 
group differences were similarly assessed. Each of the concepts 
Included the three typical semantic factors; evaluation, pother, and 
activity. No intercorrelatlon was reported to establish that rhe 
observed scores for these factors within the pretest, or within the 
posttest, were Independent- However, independence of pre-to-post 
data was tested using a regression technique. No achievement measure 
was reported, even though achievement was a consideration In the 
rationale * 



Significant differences were found for two of the concept areas 
within the experimental groups lower ability students within the 
group using the specially prepared materials displayed a more positive 
attitude, as assessed by the semantic differential administered, 
towards the science class (sc) and the science laboratory Csl) - No 
pre-to-post differences were found for their attitude on the other 
factors (st, s, c) > No pre-to-post differences were found for lower 
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ability students not using the specially prepared materials. According 
to the data reportedi pretest scores did not predict the posttest scores 
according to regression technique.. This was Interpreted to Indicate 
that the change in attltuf^as sdsessed was the result of the luaterials 
and activities utilized with the experimental group and not of other 
external factors > 

Interpretations 

Only one major Interpretation was proposed and It generally 
restated the findings. That was» that the materials did significantly 
Improve the attitudes of lower ability students toward science class 
and science laboratory type work and that this change was due to the 
materials and not due to other external factors. The author suggested 
that the study demonstrated an effective approach for developing 
raarerlals designed to improve attitudes of Inwer ability students. 



ABSTRACTOR'S ANALYSIS 

Assessing attitudes and attitude changes remains a difficult task 
without many clearly defined conceptual frameworks. Eevlews of the 
literature in this area reflect this problem and tend to reveal more 
conflict than consensus. Clearly the problem of suitable Instrumental 
tlon Is a major contributor to this confusion. Most researchers In 
this area consider the semantic differential technique far less 
appropriate than are other techniques. In this case, the population 
consisted of mostly lower ability students with reading difficulties 
andt Judging from the IQ range> low verbal comprehension as well. 
Their complex^ emotional responses were^ however^ measured by a verbal 
instrument requiring the student to perform some rather high level 
verbal discrimination.. Research of this type would strongly benefit 
from others more relevant techniques. 

While instrumentation in attitude studies is always a first 
problem to be solved^ a secondj more subtle but still important^ 
problem also needs attenrion. This one is concerned with the actual 
treatment. Charters and Jones (1972) suggest that too often research 
Is assessing ^*non-evenrs," That Isj from the student's perspective^ 
nothing different has occurred. In this study^ something different 
did occur. The experimental group did something different than the 
conrrol group, However^ what that was remains unknown as no descrlp- 
rions of student activity were provided.. Control group classes did 
something^ but not even the name of the materials used was provided^ 
Since the point of the study is to eventually lead to some association 
between class activity and student attltudei it is fundamentally 
necessary thar the class activities be described for not only the 
experimental group but also for the control group.. 

Many sets of data were presented in the studyf eleven tables in 
all, Koweverj only two are really relevant to the study's main 
premise. Since no variance measures^ such as standard deviation^ 
are reported^ many In-depth reflections reraaln beyond revlev here.. 
Without this Information^ the validity of comparing scores from 
experimental to control remains in question^ since the two groups are^ 
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to begin with, non-equivalent. Are there variances within a suitable 
range chat these sets of scores can be coiupared in their raw form 
using AK0VA7 Also limiting further interpretation of the data is the 
coiDplete absence of any explanation of what the semantic descriptors 
were and how student responses were combined Into some score. The 
lack of testing for Independence of the factor scores raises some 
question about the Importance of the significant differences found^p 
Were there really six significant differences within the pre-to-poat 
experimental data or was there only one significant difference mea- 
sured six times? Without any test of independence the answer will 
remain unknown. 

The regression technique attempted to establish that the posttest 
factor could not in most cases be predicted by some combination of 
the pretest factors^. Results of this analysis were reported in Tables 
6 and 11^, It should be pointed out that each table reports the results 
of 25 regression analyses for any one posttest factor- All pretest 
factors except the corresponding pretest factor were combined to see 
if they could predict the outcome* It can be also stated as follows: 

where p'*E is a posttest factor, p*E is a pretest factor, and f repre- 
sents some function that associates them and Is equivalent to R^. 
Notice that the pretest factor (sc) is omitted since the regression 
is trying to predict the (sc) posttest factor* Iti examining these 
data, Che degrees of freedom should be 4, 16 not 18. Some other 
checks of the F's reported Support a suspicion that inappropriate 
regression information Is Included in these tables. Furthermore » 
keeping In mind that the regression represents predicting without 
the corresponding pretest factor> the lack of significance may mean 
that pretest scores do predict posttest scores, but one to one^. If 
this were true, then the in terp re cation provided is as misleading as 
is excessive manipulation of data^p A simple* straight forward analy- 
sis would do much to clarify many questions^. Correlation would no 
doubt be amply suitable, considering the generally high level of 
random error probably existing In data of this type* The existence 
of this random error would contribute to independence as random num- 
bers neither correlate nor predict one another* 

Assuming at face value that the data have meanir;gr more should 
be said concerning where the differences occurred and what they mean. 
Specifically, the control group exhibited no change in attitude while 
the experimental group did. What were the n^lasses in the experimental 
group doing? The experiments included In ttte heat and temperature 
imlt include many interesting manipulations of equipment. Lo^r 
ability students involved in this group would normally b<> reading 
books and listening to the teacher. These students find book work 
too often difficult even though they get lots of it anyway, A change 
in pace is a welcome relief. The shifts in attitude for class and 
laboratory are not unexpected* However, the topic of those activities 
would seem to be of little student concern since no shifts on that 
factor (c) occurred. Similar lack of shifting in school (s) or 
teacher (st) factors also support the notion that the change in 
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in5 CrucCional pacccrn affected cheir attitude tcfaard that Inscraccional 
paccern^ buC probably had liccle effecC on Cheir attitude toward 
science* 
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Expanded Abstract and Analysis Prepared Especially for I..S,E, by 
Ronald D, Simpson^ North Carolina State University, 



The purpose of this study was to examine changes in attitude 
among undergraduate university students toward *'science and the scl' 
entific institution" between 1967 and 1971, The Schwirian Science 
Support Scale was used to measure these potential changas. 



Rationale 

During the time this investigation was being completed and this 
article was being written, there was a definite "feeling" among 
science educators that our country was experiencing a backlash toward 
science and technology, EJementary and secondary school students 
were fighting pollution and "ecology*' became a household word almost 
overnight. Large sums of money had been pumped into scientific en- 
deavors all through the sixties; yet the mood of our country seemed 
to be a troubled one* with more complex problems seemingly than ever 
before. The investigators in this study, therefore, sought to 
generate comparative data that would substantiate or refute the notion 
that students in 1971 possessed less positive attitudes toward science 
than their counterparts in 1967, 



Research Design and Procedure 

The Schwirian Science Support Scale (Tri-S Scale) was adminis- 
tered to 398 undergraduates (mostly education majors) at a large mid- 
western university in 1967, Different undergraduates taking the same 
course at the same institution in 1971 were administered the Trl-S 
Scale again, a total of 153 students this time. Scores were based on 
a 20-itemfr shortened version (Form A) of the original 60-item scale. 
Since the Trl-S Is a 5-point, Likert-type scale, a 20-ltem form would 
produce a mlninium score of 20 and a maximum score of 100, 

The data analysis consisted of nine two-way analyses of variance. 
The major independent variable, time of administration (1967 and 
1971), was always one of the factors. The second factor in each ANOVA 
consisted of each of the nine following contingent independent variables 
Cl) student's age; (2> student's sex; (3) student's religious 
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preference; (i) father's education; (5) mother's education^ (6) father's 
occupation; (7) student's academic major; (8) student's hotaetown siae; 
and (9) the type of high school from which the student was graduated. 

FjLndln^ 

The singlet one-way analysis of variance perfonoed between 1967 
and 1971 respondents exhibited no statistically significant difference. 
In factt the 1967 and 1971 group mean scores were 75.47 and 75.14 
respectively t indicating almost Identical reactions to the Tri-S Scale 
by the two groups of students compared in this study. 

data were analyzed by ANOVA relative to the nine contingent 
Independent variables » only two produced statistically significant 
differences — father's occupation and student's hometown siae. Aside 
from thlst no significant differences in science attitude scores were 
observedj either as a function of the major independent variable^ time, 
or as a function of the other seven contingent independent demographic 
variables . 



jr.t^rpretatlons 

This study was designed to iitves tlgate potential changes in atti- 
tudes tO'.;'ard science between students taking a similar course af a 
large mldwescem university in 1967 and 1971. The attitudes of these 
two groups of education majors toward science and the scientific 
enterprise did not change as a function of time as measured by the 
Trl-S Scale. On this count the investigators concluded: "Perhaps 
the criticism of science that we hear from among the young is not so 
luch a criticism of the value of science Itself^ but of the lack of 
responsiveness of the scl itlfic institution to their cry for assist-- 
ance In the amelioration o- what to the youth seem to be mankind's 
overwhelming problems." 

Data from this study indicated that^ In general^ the "higher" the 
occupational level of che student's father (laborer, blue collar^ 
white collar and prof ess ional) » the more positive was the student's 
atcitude toward science^ with levellng-off noted between the offspring 
of white collar wi^rkers and professional men. Statistically signifi- 
cant differences between mean Trl-S scores were also seen relative to 
the siae of the hometown In which the students lived while they 
attended high school. Students in this study from farm^E ^r from 
communities of over 100^000 In population exhibited little difference 
in attitudes toward science in 1971 than they did In 1967. Converselyj 
the students from medium and small-size communities showed a more 
positive attitude toward science In 1971 than they did In 1967. The 
authors of this paper attributed Increases in posltiveness of s<:^i- 
entific attitudes to recent increases In coverage of scientific and 
technological events through mass media and improved science educa- 
tion programs in die schools. Small and medium size communities* 
the Investigators stated* have experienced these advancements to a 
larger degree than have farm-isolated and big-city environments. 
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ABSTRACTOR'S ANALYSIS 



One of the most active yet challenging areas of educational 
research today is that of measuring affective outcoiues of students 
and searching for relationships that potentially exist among atti' 
tudesi valuesi and cognition* Studies like this one are very worth- 
while and more are needed. This investigation not only considered 
relationships among attitude toward science and nine demographic 
variables! but sought to establish a data base over time whereby 
changes in attitude could be quantified^. Statistical procedures 
used in this study appear appropriate, and the investigation was 
communicated to the reader in a clear> well'written manner* 

As with any research effort, there is always room for construc- 
tive criticism* Investigations where the feelinj^ of people are 
examined are particularly difficult to design> control, and make 
general I zarions from* Having been involved in research of this type> 
this abstractor can appreciate the many difficulties associated with 
investigations like this one. Having appropriate populations avail- 
able for study, having valid and reliable instruments available for 
quantifying the affective entities in question, and drawing con- 
clusions from data that are usuaJIy very global and complex repre- 
sent only ^ few of the 'typical problems faced* Since the phenomenon 
of ^'attitude*' Is essentially a psychological construct ) ^'esearch 
efforts designed to approach this topic e^qierimen tally are seldomi 
if ever, as "clean" as research where more discrete variables are 
being s tudied , 

In my opinion> weaknesses associated with this study fall Into 
two major categories. First) the sample — particularly the 1971 group 
— is restrictive- The investigators, through ANfOVAj search for dif- 
ferences among varicus demographic characteristics! yet In some 
groupings there are less tlian 10 students represented. In fact, the 
investigators stated at the beginning of their paper that the purpose 
of the study was toatamine change in attitudes toward science which 
had occurred among Undergraduate university students" between 1967 
and 1971* Table I in their article, however, shows that out of the 
153 respondents, 148 are education m^ijors (presumably elementary 
education), one is a liberal ar^s major> and three are *'other,^' 
Since all these students are enrolled in the same course at the same 
university and are largely majoring in the thing, it is difficult 

for me to Jabel this group "undergraduate university students*" In 
short, comparing a rather select group of majors from only one univer^ 
sity enrolled In an elf'inentary education course in 1967 with a similar 
but much smaller group enrolled In the same type of course> only four 
years later> hardly speaks for "change in attitudes toward science 
of und/sr graduate university students," 

The second category of concern by the abstractor associated winh 
this investigation is the instrument used in measuring "attitudes 
tcMard science ^nd the scientific Institution**' While earlier research 
by Schwirian (2) reported favorable reliability estimates with the 
Tri-S when used with university undergraduate students> a research 
report by Simpson, et al (3) questioned the validity of this instrument. 
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When the Trl-S Scale was used with 616 high school students, It vas 
found to contain many items too abstract for eliciting student fee lin gs 
toward science The Tri-S id based on five basic cultural values 
identified by Bernard Barber (I) that are considered necessary before 
science as an enterprise can flourish in any society. Whether or not 
this instrument actually measures a student's attitude toward science 
as an object of affect is sti ll questionable. 

Before investigators of attitude change can hope to assess the 
attitudes of any population toward any object, they muat be assured 
that Che instrument or technique used contains tangible or concrete 
items to which respondents can attach their f eelings Moreover, 
these stimuli should represent valid or ^*real" dimensions of the 
attitude object and be structured to discriminate a wide range of 
feelings. Close examination of the Tri-S Scale by this abstractor 
raises serious questions concerning the appropriateness of this 
instrument to accomplish this task — namely that of careftilly deter- 
mining how students feel toward the products and processes of science. 
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Expanded Abstract and Analysis Prepared Especially for I^S.E. by 
Robert L. Stelner, Xhe Ohio State University. 



Purpose 

The authors* stated purposes were twofold: (1) to see If 
differences in teacher science support, as measured by the Science 
Support Scale, Tri-S , (Schwtrian, 1968) produced differences in 
student science support, and (2) to assess the appropriateness of 
using the Tri-S as an instrument for nteasuring attitudes toward the 
support of science among ^igh school students. 

^'It was hypothesised that teachers with ^high* support of 
science would produce students with significantly higher support of 
science ^d that the Tri-S vould be a valid and reliable tool to 
n^asure these attitudes.*^ 



Rationale 

The need of greater emphasis on the affective domain iti science 
teaching and learning is often expressed by acience educators. The 
study of the affective domain entails at least two significant 
aspects: (1) accurately assessing or measuring effective attributes^ 
and (2) effecting changes in affective attributes. Both are important 
aspects to study, but It is difficult to do the second without having 
adequate Instrumentation to be able to do the first. 

The assessment or measurement of affective attributes necessi- 
tates the use of appropriate, valid> and reliable instruments and 
techniques. Instruments used to measure achieveiuent In non-cognitive 
areas should be carefully analyaed before they are recommended for 
use with specific populations. 

Non-cognltlve outcoines are learned, just as are cognitive out- 
comes « We should be concerned with those factors which contribute 
to this learning. Teachers with a different level of a non-cognitive 
attribute might produce students with different levels of the non- 
cognitive attribute. 
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Regearch Pealgn and Procedjare 



The study was basically a correlational study lacking a specific 
experimental treatuaetit from which a causal relationship might be 
implied- The authors looked at the possible relationship between 
student scores on the Tri-^S and the scores of their teachers whose 
class they had been in for the academic year* 

All tenth gfade biology teachers (K = 2A) in a large metropolitan 
school system {9 high schools) Tiear Atlanta were administered the 
Tri^S at the beglnnir»g of the 1969-70 school year* One of each 
teacher's biology classes was randomly selected and the Tri*S was 
administered co the class during the first two weeks of September and 
again during the first two weeks of May* There were 618 students In 
the 24 selected classes who completed both administrations of the 
Tri-S * 

The 24 teachers were separated Itito four groups of six each* 
according to their score on the Trl-S * The groups ranged from a 
"high" science support (group 1) to a "low" science support (group 
4) with two intermediate groups (2 and 3). 

Student scores were analysed for the following; (1) gain from 
pretest to posttest* (2) differences between students of the four 
teacher groups on each of the five subscales of the Tri*S and on the 
total scale» (3) reliability estimates for each of the subscales and 
the total scale* and (4) a factor analysis of the intet-item correla* 
tions* 

The reliability of the pretest administration of the Trl^S was 
determined using Cronbach^s coefficient alpha* an estimate of internal 
consistency* The factor analysis of the inter-item correlations was 
used to examine the construct validity of the Instrument- 



Findings 

The students of the fout' different teacher groups were not 
significantly different on four of the five subscales and on the 
total Tri-S* The F value obtained was significant at the 0*01 level 
on one of the subscales^ 

Duncan*s Multiple Range test indicated that students of the 
teachers in the high group (group 1) scored significantly lower than 
the students in the other teacher groups. The Students in the low 
teacher group (group 4) scored significantly higher than the students 
In teacher group 3* 

A rank order correlation coefficient between the teachers' 
scores and the posttest class mean scores of their students was ortly 
0,128, 
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The aubscsle reliability estimates using the Cronbach's coef' 
ficient alpha ranged from 0.338 to 0*556 which were ^11 lower than tha 
results obtained by Schwlriaiii 

Factor analysis did not yield the predicted five subscalee of 
the instrument* The item factor loadings were generally low. Some 
items loaded on more than one factor* The first factor was the largest, 
with aZo^st one half of the items loading on it, and only a few items 
loaded on the last two extracted and rotated factors* In no case did 
all items of the theoretical subscale load on a single factor. 



Interpretations 

Student scores did not significantly increase from pretest to 
posttestf suggesting that either science support as meaaured by the 
Tri-S was not increased by an introductory biology class or that the 
Tri-S was not sensitive in measuring gain^ in affective achievement 
relative to cultural values within the Tri^S* 

Students of high science support teachers did not score signifi- 
cantly higher than the students of low science support teachers* 
suggesting that teachers with high science support were no more 
effective in communicating this attitude to students than were teachers 
with low science support scores* In fact, no teachers were particu- 
larly effective in communicating science support attitudes to the 
students* Another possibility suggested by the authort? was that the 
Tri-S was possibly not measuring increases in science support* 

Based on teacher feedback and reliability estimates on the sub-- 
scales and on the total instrument, the authors suggested that students 
had difficulty comprehending many items on the scale* The factor 
analysis of the student responses indicated that not all items oxt the 
subscales were being interpreted in the same manner by all students'* 

The authors suggest that the Tri-S Is not a reliable instrument 
to measure achievement of high school students in the affective domain* 
Apparently 'Vhen the Tri-S is administered to tenth grade students, 
it is not a valid assessment of the five cultural values which is 
purports to measure**' 

It appears *'that the Tri-S Is either not a valid tool for 
assessing growth in science support among high school students or 
that the teachers in this study were not effective in bringing about 
significant attitudinal changes during the introductory course in 
biology*" 



The authors have addressed themselves to a problem which is 
quite prevalent in science education research within the affective 
domain* That is, the problem of reliable and valid assessment. 
Numerous Instruments developed and piloted in dissertation research 
are either never used again or are assuimed to be valid and reliable 
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instruBnents for use with populations other than the one uaed in the 
instrument development* Perhaps if fewer instruments were developed 
and nkore time were devoted to verifying, modifying, improving and 
increasing the usability of already-developed Instruments ^ science 
education research would be ahead* 

The authors* have critically analyzed one such instrument, the 
Tri-S » to determine its appropriateness with ^ population other than 
the one with which it was developed* The instrument was developed 
using undergraduate college students, but the instrument developer 
suggested that the instrument might be appropriate for use with high 
school students* The authors examined the use of the Tri-S with high 
school biology students in a large metropolitan school system^p 

The authors^ analysis of the Tri'S represents a useful 
necessary piece of research^ but the second part of their work^ to 
determine if teachers with different science support scores produce 
students with different science support scores» is questionable. 

At best^ the authors* could only look for a relationship between 
teacher and student scores* To hypothesize a causal relationship is 
totally outside the realm of this study as it was carried out^. 

There does not appear to be any theoretical basis for expecting 
that students will increase their scores on the Tri-S, There is no 
indication that an objective of the biology teachers, or courses, 
was to increase science support. Similarly there is no reason to 
expect that teachers with high science support scores will produce 
students with higher science ^support scores. In other words» there 
really was not an experimental treatment from which predictions could 
be made and a causal hypothesis tested. 

Because the student scores on the Tri-S did not increase from 
pretest to posttest^ the authors' concluded that "either 'science 
support' as measured by the Tri-S was not increased as a result of 
an introductory biology course or that the Tri-S was not sensitive 
in measuring gains in affective achievement relative to the cultural 
values within the Tri-S," 

It is perfectly possible for the instrument tg be valid and 
reliable, and for the course not to produce any change In science 
support* It is also possible for the Instrument not to be valid 
and reliable and for. the course to produce changes in science support* 
Howevert since there does not appear to be any controlled effort to 
produce a change in science supports there is no reason to expect 
one* making this part of the research rather questionable. 

The question of the validity and reliability of the Tri-S with 
high school students could be examined without being concerned 
whether tenth grade biology teachers produced any differences in 
student science support. 

The authors* found the reliabilities of the subscsles and the 
total Tri-S to be lower than Schwirlan's original results. Based 
on teacher feedback^ they concluded that students had difficulty 
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comprehending many items on the Tri-S. The results are not surprising 
since the range of student abilities In the tenth grade of high school 
would be much greater than In undergraduate college classes* The 
authors* use of the Cronbach coefficient alpha would be a better esti- 
mate of Che internal cotisistency than the split half method used by 
Schwirian. Whereas the Cronbach coefficient alpha is the average of 
the split halves, the split half method used by Schwltian could vary 
depending on the particular split used to determine the correlation. 

Factor analysis is a method Increasingly being used to help 
determine the construct validity of instruments* The authors* find- 
ings support their conclusion that the validity of the Trl-S ua*id 
with high school students is questionable. They suggest that certain 
emotionally charged words such as homosexual, sex deviants, godless- 
ness appeared to distract students from the meaning of the subscales 
In which the Items were fcund* That less mature high school tenth 
grade students would be more reactive to words like the above than 
would college students would not be surprising » 

The statistical analyses used in this study should have been 
confined to those which indicate relationships between the teachers* 
scores In the Trl-S and their students* class mean scores on the 
Trl-5* A number of computer programs allow the researcher to look 
for linear, as well as higher order, relationships between variables. 
This type of analysis would have been more appropriate and powerful 
for the researchers to use than was the analysis of covarlance tech- 
nique used. 

Although the relationship between teachers* and students* science 
support would best be examined utilizing correlational analysis, 
many correlational studies do use an analysis of variance technique 
as the authors have done. Since the authors were comparing the four 
teacher-student groups on each subscale and on the total Tri-S using 
the pretest scale scores as a covariant, perhaps a multivariate test 
would have been more appropriate, rather Chan the six univariate tests* 
The univariate tests would have been appropriate if the subscales 
and the Trl-S were relatively Independent, that Is, with small inter- 
correlations. The authors do not report the intercorrelations between 
subscales and the Trl-S, so it Is Impossible t6 detennlne if a multi- 
variate test was more appropriate. 

The use of the Duncan Multiple Range test to determine if signifi- 
cant differences existed between the Individual student groups on 
the one subscale of the Tri-S for which a significant F-value was 
£ound Is somewhat questionable. Glass and Stanley (1970) have indi- 
cated that '*Duncan*s procedure has been the most popular in the 
behavioral sciences and education; but until mathematical statisticians 
resolve their differences or satisfy one another that the derivation 
of the procedure is valid, it might be wise for persons In applied 
fields to observe a moratorium on Duncan's procedure" (p. 383). The 
Tukey post-hoc multiple comparison procedure would have been more 
appropriate . 

Host of the values In the tables of the report are given with 
at least three and sometimes five significant figures, yet the 
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original nieasures of the variables did not have this many significant 
figures. As science educators, we should use care that our reports 
do not irnply greater precision and accuracy than Is warranted. 

I believe that the study Is lacking with respect to the second 
problem due to the absence of a theoretl:;al basis and treatment for 
predicting any change in student attitudi*s toward the support of 
science, but, overall, the authors have addressed a serious problem* 
Their conclusion that the appropriateness of the use of the Trl-S 
with tenth grade students is questionable is supported by their study 
and should be heeded by others planning to use the scale. Another 
study raising some concerns regarding the use of the Trl-S has been 
carried out by tfideen (1971). The current study clearly points out 
the need to carefully pilot Instruments with populations with which 
the instrument is to be used. It also suggests the desirability of 
improving existing instruments instead of starting from scratch to 
develop a new instrument* 
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Merkle* Uale G. » "A Leadership Workshop on Elementary School Science; 

An I:i-Depth Evaluation.'* Journal of Research In Science Teaching , 

Vol. 1, No. 2:121-133» 1970. 

Dt^scrlptors — ^College Teachers » ^Elementary School Science^ 
In^ervlce Education^ *Prograin Des crip t ions » *Program Evaluatlonj 
*Teacher Educatlont Workshops 

Expanded Abstract and Analysis Prepared Especially for l.S.E. by 
William S. LaShler, Jr.* University of Kansas. 



Purpos e 

During the suiLBer of 1968» an tfSF^sponsored Leadership Workshop 
on Elementary School Science was held at Michigan State University. 
The 30 participants included elementary science consultants* science 
supervisors and college and university professors currently teaching 
science and/or science education courses for pre^service elementary 
school teachers • 

Tha pvirposea of thla workshop were detenoine the relative 
effectiveness of different workshop activities and to determine how 
these activities related to subsequent changes in the behavior of the 
workshop participants. A further objective was to follow up the 
effectiveness of the participants as they engaged in post-workshop 
implementation activities* 

The four-week- workshop provided the participants with an orlenta" 
tion to the AAAS Sclence-A Process Approach materials and the Science 
Curriculum Improveiaent Study material. The participants used theSe 
materials In micro-teaching experiences with children as well as In 
observing experienced teachers using these two curricula with children. 

The workshop participants received training In both group process 
skills and change-agent skills* These slcllls were considered Important 
since the participants were also Involved In preparing appropriate 
materials and activities for future orientation sessions and in- 
service programs. During the final week of the worltshop nine partici- 
pant teams were formed and these teams Instructed elementary school 
teachers for three days at the Michigan Education Association Camp. 

A mid-winter evaluatif/n conference was later attended by 28 of 
the college teachers* Through group and Individual Interaction 
sessions the staff obtained feedback from the participants* 



Research Design and Froc^f3uxe 

The seven Instruments used in this study were developed by the 
staff of Michigan State University. The instruments or question- 
naires wore generally intended to measure change in participant 
response over tlJDe or to seek evidence :>f linear relationships among 
the Ins trumenus * 
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Instroments A., B, and £ were admlnl^Cered In th& pretest, post- 
t^stt and mid-winter conference* Instruments C and D were used In 
the pretest and posttesC. Instrument F was ased in the posttest and 
mid-winter conference. Instrument G was used only in the mid-winter 
conference* 

Instrument A, Knowledae of Program Characteristics and Program 
Implementation t was a fifty-seven item multiple choice instrument 
which assessed knowledge of the AAAS and SCIS programs^, Instrxmient B> 
Attitude Touard The AAAS and SCIS Programs and the Content of These 
Pro^rama, combined sixteen Likert Scale items plus two <)uestions 
related to program preference^. Instrument C, Analysis of Personal 
Behavior in Croups , was an attempt to measure the effectiveness of 
the group process sessions using a weighted rankings. Instrument D» 
Knowledge of Change-Agent Strategies , was used to measure change- 
agent skills of the participants. Instrument E, Satisfaction of 
Perceived Heeda ^ was used to determine participant needs in areas of 
school community expectations and the new science curricula with 
responses scored on a one to five weighted basis^p Instrument F, 
Evaluation of the Divisions of the Workshop ^ called for the partici^ 
pants* opinions on statements related to five components of the work- 
shops. Instrument G was ^ questionnaire which asked for evidence of 
change in such areas as number of recent formal class sessions devoted 
to AAAS and SCIS In contrast to similar activities the previous year* 

The first four hypotheses of the study tested the significance of 
the difference between pretest and posttest scores of the 30 partici- 
pants on each of the instruments A, B> C, and D^, A one-Lalled test 
of significance was used with the paired t-test. 

The last four hypotheses were attempts to show significant 
Pearson product-moment correlations among different measures. The 
tesearcher indicated the possible presence of these correlations would 
assist future designers of workshops in the selection of activities 
and participants HP 



Findings 

The tests of the first four hypotheses indicated that there were 
significant differences between pretest and posttest scores on instru- 
ments Aj B, C, and D, The workshop was described as a successful 
vehicle for increasing the knowledge of the participants in the topics 
of the workshop and for creating a positive attitude toward the AAAS 
and SCIS programs. The participants also showed marked gains in 
knowledge of change-agent skills* The final four hypotheses dealt 
with correlations among the instruments and findings indicated no 
significant relationships. 

The study also included descriptive data that were not statis- 
tically treated. For example on post-workshop Instrument the 
participants ranked the participant-run three-day workshop 39 the 
most important activity. The participants ranked the sessions on 
Change-Agent Strategies and Group Processes low in every category of 
measure , 
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Instrument E provided data to contrast the perceived pretest 
needs of the participants with the posttest satisfied needs of the 
participants* Ttxe researcher indicated that those needs considered 
to be the most outstanding needs were satisfied almost fully* 

Instrument G provided descriptive data indicating that the parti- 
cipants had Increased the number of class sessions devoted to AAAS 
and SCIS and increased the number of workshops as contrasted with 
efforts the previous year* The participants reported an Increase in 
colleagues using the new science curricula as well as increases In 
the number of consulting requests* 



Interpretations 

The researcher Indicated that cognitive and affective changes 
were brought about In this leadership workshop* 

The information obtained on Instrument F indicated that a three- 
day workshop run by participants should be included in subsequent 
summer workshops* Future workshops should consider giving less time 
for group process skills and change-agent sessions* 

From the participants' mid-winter conference responses on Instru- 
ment G, the researcher concluded that a definite increase in the use 
of the processes of science and a definite re-alignment of many pre- 
servlce programs had begun as a partial result of the leadership 
workshop * 



In this descriptive study of a HSF leadership workshop, all 
evaluation Instruioents were locally constructed* No evidence was 
presented regarding reliability or validity of the seven instruments* 
The lack of significant correlations among the instruments may possibly 
be related to low validity and low reliability of these measures* 

The use of a one group, pretest, posttest design served only to 
Indicate change in certain cognitive and affective areas without 
excluding alternative explanations such as Increased sensitization 
due to pretests* The brief description of Instrument C implied that 
some type of ranking was involved in the responses which would suggest 
the use of an appropriate nonparametrlc statistic* 

This research study exemplifies the problems of extending a study 
over too many areas using unproven instruments* Helgeson (3) > after 
a review of 138 NSF Teacher Institute research studies, pointed out 
the difficulty In pinpointing the precise nature of the Impact of 
institutes on education* 

In fairness to the author of the workshop article. It should be 
noted that in 1963 the HSF placed only limited emphasis on formal 
evaluation of workshop effectiveness* Nevertheless the workshop 
staff did initiate evaluation activities in several area? previously 
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alighted. The innovative areas investigated at the workjjhop included; 



1. identification of participant perceived needs and sub- 
sequent degree of needs sa tisf action^ 

2. formative reactionnaires administered after each major 
activity t 

3. evidence of attitudinal change^ 

A. effectiveness of participants in initiating changes in 
the colleges or schools^and 

5.. emphasis on change-agent strategies.. 

The following cursory review of these five research areas may 
suggest alternative means of evaluating programs for Inservlce 
educators ^ 

Perceived Heeds > Hall^ Wallace^ and Dosaett (l) described a 
Concern 3 -Based Adoption Model with seven operationally defined stages 
of concerns believed to be generali^able to most educational inno- 
vations*. A Concerns Questionnaire based on the model is currently 
being validated with a sample of SCIS science teachers. The avail- 
ability of a valid instrument would be helpful in seeking a match 
between workshop participants' concerns and the subsequent instruction*. 

Formative ^. valuation . Rowe and Hurd (7) described an engineering 
research approach for use in inservice programs to diagnose sources 
of resistance to innovation*. The measures used in the study Included 
two three-part scales labeled Wot Interesting ^ Interesting * Vety 
Interesting and Hot Useful ^ Useful ^ and Very Useful > The Instruments 
were administered after each of s1:k inservice sessions*. The results 
supplied immediate feedback on the status of the session. The use 
of the Contingency Coefficient as described by Siegel would be useful 
in detftctlng significant differences in the perceived usefulness of 
specific activities among different groups such as college teachers 
and curriculum supervisors* 

Attitudinal Change . Moore (6) used the Science Teaching Attitude 
Scales in a two-year study of attitudinal changes in a KSF-CCSS group 
of elementary school teachers*. The results of the study indicated 
that the workshop had an observable long-range positive effect on 
science teaching attitudes but not on attitude toward science*. The 
careful development^ field test, and validation of the instrument by 
Moore (5) serves as an excellent model*. 

Levels of Use > Hall, Loucks^ Rutherford^ and Kewlove (2) 
operationally defined eight sequential levels of use of an innovation*. 
An interview technique is. presently being used to classify users of 
specific innovations*. A workshop director would be materially 
assisted in building flexibility into a program if he or she had prior 
knowledge of both the concern stage and level of usage of participants 
interested in new science curricula*. 
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Change-Agenc ScraLegles ^ Mahan (4) described a four-year effort 
of the Eastern Regional Xnstltute for Education (ERIE) to Implement 
AAAS Science - A Prpcess Approach materials in fifty-three elementary 
schools* Sixteen guidelines for curriculum Installers emerged from 
the results of two contrasting Installation strategies used by ERIE, 
The guidelines and supporting evidence should be on the reading list 
of all aspiring change-agents. 
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Roberts* Richard A*, and Jacob W- Blankenship* '*The Relationship 

Between the Change in Pupil Control Ideology of Student Teachers 
and the Student Teacher's Perception of the Cooperating Teacher's 
Pupil Control Ideology." Journal of Research In Science Teaching ^ 
Vol, 7» No. 4:315-320* 1970. 

Descriptors — ^Cooperating Teachers* Class Managementt 
^Elementary School Teachers* Inquiry Training* Preservice 
Education* ^Student Teaching, ^Science Education, *Teacher 
Education, Teacher Behavior 

Expanded Abstract and Analysis Prepared Especially for I,S,E* by 
Vincent W- Lunetta, University of Iowa. 



The study investigated change in the pupil control Ideology 
(PCI) of elenientary student teachers and the relationship of this 
change to the student teacher's perception of the cooperating teacher's 
pupil control Ideology* The research hypotheses tested weret 

1. Is there a change in PCI during student teaching? 

2. Is there a difference in student teaching grade level 
betwfii^n those student teachers showing no increase in 
custodialism and those showing greatest increase in 
custodialism? 

3. Is there a difference in the perceived PCI of cooperating 
teachers between those student teachers showing no 
Increase in custodialism and those showing greatest 
Increase In custodialism? 

4* Is there a difference tn mean socialization pressure 

experienced by those student teachers showing no increase 
in custodialism and thase showing greatest increase in 
cus todialism? 

5^ Are there differences In the change In PCI of student 

teachers in situations of low, medium, and high soclali^ 
zation pressure? 



The authors base the need for tb^ study upon the fact that 
'^successful itnplejuentation of new curricula**, ^requires careful 
consideration of*.**the teacher-pupil relationship." The contemporary 
emphasis upon inquiry teaching requires that the student's role change 
"from one of dependency upon the teacher to one of competency in 
directing his or her own inquiry activities." Yet, the authors sur" 
raise that teachers ™ay be reluctant to relinquish control over student 
activity, and this niay inhibit the effectiveness of an inquiry approach 
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to teaching* The authors write that a review of the literature 
revealed that the behaviors acid attitudes of the cooperating teacher 
have a significant influence on the socialization process of preservlce 
teacher education* 

The report cites a veT7 limited number of relevant research 
studies* It reports one study by Meyer Horowitz (l) indicating that 
the differences the student teacher perceives between his views and 
those of his cooperating teacher are even more crucial than are the 
actual differences. 



Research Design and Procedure 

Pupil Control Ideology (PCl) was measured on a twenty-Item 
instrument developed by Willower^ £idell» and Hoy (2)* The PCI 
form was administered to preservice elementa>^ teachers CK-6) in the 
last semester of their senior year. During that semester the students 
participated in eight weeks of on-campus methods instruction followed 
by eight weeks of student teaching. The PCI form was administered 
as a pretest during the fifth week of on-campus methods instruction. 
It was administered again^ as a posttest* during the last v?eek of 
student teaching. A modified version of the form was developed to 
assess student teachers* ;^rceptions of their cooperating teachers* 
pupil control attitudes* Fhis form was administered during the final 
week of student teaching. 



"The difference between the student teacher*s pretest 
PCI Form score and the Perceived PCI Form score of 
her cooperating teacher was used as a measure of the 
pressure felt by the student teacher to bring her 
views on pupil control into agreement with those of 
the cooperating teacher***" 



Subsequently t the relationship between socialization pressure and 
the change in student ceacher pupil control ideology was examined* 



1* A t-test showed changes In student teachers* PCI that were 
significant beyond the *01 level from pretest to posttest. 
I'he direction of mean change on a humanism-cus todialism 
scale was toward custodialism* 

2, A Kolmogorov-Smimov test for differences between the 
student teaching grade levels and change in PCI did not 
permit rejection of the null hypothesis* 

3* An analysis of variance showed a relationship between 
perceived teacher PCI and change in student teacher PCI 
that was significant beyond the *05 level, 

4* An analysis of variance showed a relationship between 

mean socialization pressure and change in student teacher 



Findings 



36 



mc 




PCI that was significant beyond the -01 level- (Mean 
socialization pressure vas defined as the difference 
between the student teacher's PCI pretest score and 
the perceived PGI score of the cooperating teacher). 

3. An analysis of variance showed a relationship between 
mean change of student teacher PGI in classrooms of low, 
medium, and high socialization pressure that vas signifi- 
cant beyond the ,01 level- 

A Scheff^ test applied to the data indicated significant dif- 
ferences beyond the -01 level between the low and ntediuo socializa* 
tioi) pressure groups and between the low and high socialization 
pressure groups- No significant differences were shown between the 
medium and high socialization pressure groups on change in PCI- 



Interpre tat ions 

The investigators found that the student teachers' views on 
pupil control changed in a custodial direction during student teach- 
ing- They also found a significant relationship between the change 
in PCI and the differences existing between the studenc teacher's 
own views and his perception of the cooperating teacher's views- 
They report that "---there was an increase In the mean change in PCI 
at each progressively higher level of socialization pressure-" In 
further interpretatior however, they say "the mean change in PCI 
at medium and high levels (of socialization pressure) was not signifi- 
cant- This lad: of significance indicates that there may be an upper 
limit to the socialization pressure which can bring about change in 
views 

The Investigators Interpret their findings to show the signifi- 
cance of the socialization process for persons entering the 
teaching profession- "if a humanistic pupil control ideology is 
desirable^ care must be taken to select cooperating teachers whose 
attitudes and beliefs toward pupil control are consistent with this 
desired ideology-" 

ABSTEACTOR'S ANAJ.YSIS 

This research study was timely and significant- It investigated 
an issue of concern and Interest In teacher education, and it provides 
an appropriate base for a number of related studies needed- While 
the Investigators have clearly found significant differences In 
imi^'Ortant variables, the description of the research at times lacked 
precision and clarity* and it provided a veiy limited discussion of 
iDtpllcatloQS - 

The study showed the significant effects of the attitudes of 
cooperating teachers on student teacher attitudes regarding pupil 
control* but It did not provide any direct insight regarding means 
to solve the problem that was observed- Can cooperating teacher 
models be developed that are more compatible with optimal pupil 
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cctitrcl ideology? Can ceacher education programs provide an instruc- 
tional treatment that v^ill facilitate more optimal and lasting pupil 
control ideology? What is an optimal pupil control ideology? While 
these questions were not clarified in the study, they are very appro- 
priate for subsequent investigation.. 

The comments that follow relate primarily to the clarity of the 
written report; 

1.. The rationale for the study included the assumption that 
successful implementation of new curricula demands care- 
ful consideration of the changes new strategies require 
in the teacher pupil relationship.. The correct use of 
an inquiry approach in science teaching has *'the effect 
of reducing the status difference between student and 
teacher," What is meant by '*an inquiry approach to 
instruction"? Inquiry teaching has been defined in a 
variety of ways by different writers, and references 
should have been cited that elaborated on and supported 
thx± authors* positrion^p Furthermore, what evidence did 
the authors have to support their assxamption that inquiry 
teaching is related to low pupil control ideology, ii^e^p, 
of a humanistic orientation? What evidence supported 
the authors* contention that "most teacher education 
programs approach the issue of pupil control from a 
liberal or humanistic point of view^p^p/*? 

2^ More information regarding the nature of the PCl instru- 
ments would have been particularly helpful. While a 
reference was cited, the reader was provided with no 
comments on reliability or validity. Insufficient data 
i^re available to permit interpretation of the scores 
that were reported in tabular form.. Have any studies 
to date examined the relationship between paper and 
pencil PCl scores and actual classroom behavior? Pre- 
andposttest means and standard deviations were reported 
for the PCI Forms, but no such data were reported for the 
Perceived PCl Forms for cooperating teachers. The reader 
was told that the PCl Form means were 40,7 and 45*.7 on 
the pretest and the posttest respectively, but he also 
knew that it was a 20-item instrument. How were the 
scores determined? Wliat was the meaning of the 5 point 
difference? 

3* Very inadequate information was provided regarding the 
nature of the sample of student teachers. In what kind 
of university were they students? How did their scores 
relate to national norms? In what kinds of school 
environments did they do their student teaching during 
the time of the study? 

4. What was the nature of the n^thods instruction that pre- 
ceded the pretest? Was there any particular treatment 
designed to develop a commitment to inquiry teaching or 
to a humanistic PCl? Further research studies should 
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investignte the effects of alternative treatments upon 
pupil control Ideology and related measures <^ Comparison 
with this study will lack meaning^ hohrever^ since the 
treatments were not described, 

5, The presentation of the results of the study omitted some 
important details beyond those previously mentioned (such 
as perceived PCI scores)* In the discussion of results 
relating to hypothesis 3 (page 317) ^ for exaiople^ the 
narrative and table indicated rejection of the null hypo** 
thesis^ but no coimnents or data are provided showing the 
direction of influence caused by the perceived PCI of 
cooperating teachers* The reader of ^ research report 
should not have to surmise this kind of information* 

6, In general^ the implications of the study were not dis- 
cussed as thoroughly as seems justified by the interest- 
ing results* Specific suggestions could have been directed 
to the nature of methods instruction^ to techniques for 
long term attitude change> and to the development of 
cooperating teacher models* A variety of significant 
questions for further investigation could have been 
elaborated^ such as the need to investigate the effects 

of alternative treatments upon teacher attitude and 
subsequent teaching style and behavior* 

7, While the results of this study permitted some powerful 
conclusions J the authors' concluding remarks provided a 
restateioent of some initial assumptions that were not 
evaluated in this particular study ^ These remarks were 
written in a manner that could readily cause readers to 
perceive them erroneously as conclusions supported by 
the study* The paper concludes » for example^ with the 
following final sentence: 

If a teacher feels that both status and 
authority are threatened unless students are 
rigidly controlled, the probability of the use 
of curricular materials emphasising inquiry is 
greatly reduced. 

this concluding statement is assumption^ and this 
research study provided no evidence to support or refute 
it* 
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Allen, Leslie R,, "An Examination of the Ability of Third Grade 
Children from the Science Curriculuio Improvement Study to 
Identify Esqierimental Variables and to Kecognize Change-" 
Science Education . Vol. 57, No. 2:135-151, Aprll/June» 1973, 
Descriptors — *Cognitive Developmentj Curriculum, Educational 
Research, ^Elementary School Science, *Ins true tion, *Longi- 
tudlnal Studies, Science Course Improvement Project, *Science 
Education 

Expanded Abstract and Analysis Prepared Especially for I,S.E. by 
Julian R, Brandou, Michigan State University* 



Purpose 

The purpose of this study was to compare performances on certain 
tasks between twt. groups of third grade children* One group was 
provided with SCIS science (Physical Science section) and the other 
group with a non-SCiS curriculum* 



Rationale 

This study is part of a longitudinal evaluation of the SCIS 
program, Allen refers to the 1967 Teacher's Guide for d statement of 
the goals of SCIS* The author has attempted to establish, by means 
of a factor analysis of the test Items, the "cognitive" category for 
the tasks involved (2). The population of the study likewise is dis- 
cussed in the other papers in detail (4) and depended on a matching of 
the students in socio-economic groups in SCIS and non-SCIS Honolulu 
schools * 



Research Desi^ and Procedure 

The basic design Is a posttest only, randomized within popula- 
tion, matched comparison^p The sample size was 176, representing a 
loss from the original grade one group of 300* Fifty subjects were 
randomly drawn from the SCIS population for each socio-economic level* 
The procedure was repeated in matched non-SCiS schools for all first 
graders* Full details of the distribution reinaining by sex, SCiS/ 
non-'SCiS and class are given* The children were near the end of their 
third grade program when tested In May/June, 1971, Protocols for each 
test item were generated and items were i idividually administered after 
pilot testing with grade 3 children at the University of Hawaii Lab- 
oratory School, Responses were recorded and grouped by variable, 
using procedures not described in the article reviewed. The reported 
numeral represents the number of tiioes a given variable was mentioned 
by the children in each socio-economic group in the SCIS and non-SCIS 
schools. Analysis of covariance for the responses to each of five 
items is reported with interactions using the California Test of 
ttental Maturity as covariant- T-tests on the difference observed among 
socio-economic groups were done for the entire sample. 
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Findings 

The five Items were on two objectives: 

1* Identifying variables that may affect a simple mechanical 
systen)» and 

2< Recognizing change during an experiment.. 

Items 1-4 dealt with objective one and question 5 dealt with the 
second objectives*. 



TABLE OF ITEMS AND RESULTS OF ANALYSIS OF COVAKIANCE 
WITH SIGNIFICAMT DIFFEEENCES NOTED 







Programs 


Sex 


Soclo- 


Item 1 


Eyedropper 






X 


Item 2 


Floating syringe 








Item 3 


Sling shot 






X 


Item 4 


Loaded Truck 








Item 5 


Lighting Candle 


X 




X 



T-tests show that irv all cases the upper soclo-ecotiomic group out- 
performed both the average and lower groups* On items 3 and 5 the 
average group also out-performed the lower group*. No interactioti 
effects were found*. 



Interpre tations 

"Using (a) the input variables of science program membership, sex, 
socio-economic status and California Test of Mental Maturity scores and 
(b) the criterion measures (items) previously described, Honolulu third 
grade SCIS diildren appear superior to non-SCIS children both In their 
ability to identify experimental variables, and to recognize change*.^* 



ABSTRACTOR'S ANALYSIS 

Haven't the objectives of the third grade SCIS program changed 
since 1967? Perhaps Honolulu is using the materials as produced by 
D*. C*. Heath-Ray theon or perhaps the differences are trivial and 
teachers using the current Rand-McKally materials can expect the same 
results*. What other objectives are listed by subsequent work as 
appropriate for this unit? Does the author expect any transfer to 
these tasks? 
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The study carefully delineates the protocols for the items but 
information regarding teacher reaction* pupil response* class size and 
the effects on other children in the current classes would add much 
"color" to the paper* What does the author think about the srray of 
responses given to each item? Of special interest are the observations 
made by a single pupil* Some of these are particularly astute* others 
seem so apparent one wonders about why other pupils don^t see them* 
Does the author have any qualitative "feel" for the responses? Uere 
there any expected values? How different are the socio-economic 
groups? Does a slight variation in parental income* for example* 
produce a marked difference in response frequency, fluidity, sentence 
length* use of adjactives or other observable characteristics? 

The lack of program X socio-economic interaction seems an inter- 
esting area to explore* Is this an artifact based on the covariant 
adjustment? How tightly are the California Test of Mental Maturity 
scores correlated with socio-economic class? If the SCIS program can 
succeed with all socio-economic classes, this would be an important 
finding* 
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Nicodemus, Robert B», "content and skill Hierarchies in Elementary 

Science; An Analysis of ESS Small Thines/' Jp"^:^! of Research 
in Sclt^ n ce Teaching , Vol* 7, No* 3;173-177, 1970* 

J>escriptors — Behaviijr, ^Behavioral Objectives, C<?iBplexity Levelt 
^Content Analysts, ^Elementary School Science. ^Science Course 
Improvement Project, Scienrlfic Concepts, *Sklll Development 

Expanded Abstract and Analysis Prepared Especially for i»S*E* by 
Donald E* Piechard, Emory University* 



Purpose 

The basic problems investigated are assumed (by the abstractor) 
to be related to the following questions; 

1* Ho^ do science content and the subtle and elusive 
behaviors of students and teachers relate to the 
inquiry philosophy of the Elementary Science Study 
Cess) in the unit titled *'Small Things*'? 

2* Is there any structure in "Small Things" which would 
assist a teacher to effectively plan a lesson go as 
to be able to asslsr, the learner in ways consistent 
with ESS philosophy? 



Rationale 

The author views the main activity of science to be iaquiry 
experienced through content* He Is co;tcemedt therefore, that 
important outcomes of some of the new science programs (assuioed by 
the abstractor to mean ESS specifically) are fr^ouently described as 
attitudes * He Implies that such an approach is inadequare and that 
In order for teachers to communicate Inquiry to students there is 
need for some means of measuring and describing inquiry through its 
relatioaships with content and behaviors* 

This study Is related to two other publications by the same 
author* The most pertinent is titled An Evaluation of Elementary 
Science Study as Science— A Process Approach CeRIC REPORT ED 027 217» 
September, 1968) * 



Research Besign and Procedure 

The "Small Things'* unit was analyzed using a scheme adapted from 
the Science — A Process Approach (S-APA) program* The abstractor's 
summary of procedural steps follows: 

1* The Teacher's Guide for Small Things was examined to 
determine expected student behaviors (objectives)* 
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2. Student behaviors were rewT S-tten using S-APA action 

words (i.e., id^ntl fying» distinguishing, constructing » 
describing* etc . ) . 

3*. Student behaviors were arranged in a vertical hierarchy 
analogous to the sequential ordering of objectives in the 
S-APA exercises*. 

^. Student behaviors were analyzed to determine the major 
coacept (conteat) area under which each behavior could 
be categorized. 

5. Student behaviors were grouped into levels to establish 
a general procej_g hierarchy*. The relationships among 
the levels are similar to those among the 13 different 
processes in S-APA (i.e.* observing* measuring* classi-* 
fyXngt etc.)*. Thus* while there is a general hier- 
archical sequence among the levels, the individual 
student behaviors are related in more of a non^sequential 
or horizontal arrangement than resulted from the verti- 
cal sequencing in step 3* above*. 



Findings 

1. Forty-five student behaviors were identified from the 
Teacher*s Guide for Small Thin£S > Those 45 behaviors 
do not include the first ten which repretjent skills 
for using a microscope*. (All 55 behaviors are listed 
in »;he text of the article.) 

2. Three content concept areas were identified and each 

of the ^5 behaviors was categorized under the appropri- 
ate area — (1) pond life* (2) cells* and (3) living. 

3. Seven levels of a general process hierarchy were 
established and each of the 45 behaviors was listed 
under the proper level. The seven levels were (l) 
Identifying* Naming* (2) Describing properties* 

(3) Describing similarities and differences* (4) 
Ordering, (5) Applying a rule, (6) Interpreting rela-^ 
tionships , and (7) Demonstrating validity *. 



In te rpr e ta tions 

The author states that the analysis of the ESS unit using the 
S-APA model, provides a structure which may be put to a riumber of uses. 
Among them he includes: 

1. The sequential development of content may be examined*. 

2. Behaviors may be reorganized into a General Hierarchy 
through which the development of skills may be studied. 
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3*. The greatest value may be In its use by teachers in 
planning and teaching a unit.. 

a*. The chlld^s knowledge and skills may be evaliidCed 
in relation to a hierarchy*. 

The Instructional program may be planned to avoid 
unnecessary repetition but at the same time asdure 
the possession of behaviors necessary for more 
complex tasks ^ 

The relation of content behaviors and skills may be 
readily ascertained and organized In ways useful 
to the immediate and numerous decisions which con- 
btituce part of a strategy of teaching*. 

ABSTRACTOR'S ANALYSIS 

Relationships to other studies > This investigation's relation- 
ship to the literature on the ^'cluster of reviews" topic, cognitive 
development, is limited primarily to the psychology of Robert Gagne. 
Gagn^*s theories on the sequential development of intelligence and 
the need for structuring pathways to the student's "terminal capa- 
bilities'* have been popularized In his books, including The Conditions 
of Learning^ , and nuiaerous articles such as "The Learning Requirements 
for Enquiry" ( Journal of Research in Science Teaching , 1:144-153, 1962). 

The present author makes reference to several other published 
works which are assumed to be related to the reviewed article*. The 
relationships are vague, however, and tend to give the impression 
that the current report is an abridged version of a somewhat longer 
and cnore complete manuscript. 

In terms of cognitive theory, this investigation holds that 
children must be able to recognize essential features of an objective 
or solution to a problem before it is presented and that the resulting 
recognition Is an important source of reinforcement*. Thus, the study 
supports the establishment of hierarchies of objectives, contents 
skills, and processes as a means of providing logical planning, teach- 
ing and learning sequences. 

The science processes and objectives in S-AFA are organized 
according to an elaborate hierarchlal scheme (a reflection of Gagne's 
strong Influence on the program's development). It Is understandable, 
therefore, that the author of this study selected the organizational 
structure of S-APA as a model for analysis of ESS *'Small Things." 

Contributions of the study . This Investigation's methodological 
approach represents its major contribution. It is a good example of 
the application of a specific model (S-APA) derived from general 
psychological theory (Cagne's) to the task of analyzing a teaching- 
learning system. Such a technique is welcome since there Is a great 
need in education for specific analytical models. 
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Of course, precise knowledge on teaching and learning is very 
limited. Thus, the contributions of this specific model (or any other 
for that matter) are largely matters of value judgments. Examination 
of the present study, for example, by one person who supports the 
S-APA "structured^' approach and by another who supports the ESS 
'Wssing about" philosophy would surely result in two very different 
reactions. It is most critical, therefore^ that a researcher or 
consumer of research examine the underlying assumptions of any 
specific model used in analysing a teaching-learning approach* 

Weaknesses of the study . The Tuajor weakness of the investigation 
lies in the written report itself* Most critical is rhe arricle's 
failure to communicate iti specific terms exactly what problems or 
questions were investigated. The questions stated under Purpose above 
represent the abstractor's attempt, after careful study of the arti- 
cle, to isolate and define the research questions. It was chiefly 
through the description of procedure and the summary, that assumptions 
were made about the study's purpose. Furthermore, since no specific 
probleins or questions were explicitly defined by the author, it is 
difficult to judge the validity of the remainder of the paper — pro- 
cedures, findings, and Interpretations. 

Other conmiuni cation problems appear to result from editorial or 
typographical errors. There is reference to charts (2 and 3), for 
example, which were apparently omitted from the final copy. Only their 
captions are found in the text. 

This report could have been improved considerably by: 

1. An explicit statement of purpose (problems, questions^ 
or hypotheses) early in the paper. 

2. Restricting procedural steps to those required to 
achieve the investigation's purpose. 

3. Stating explicit findings relative to the investigation's 
purpose . 

4. Making interpretations based on rhe findings of the study* 

5. Editing the manuscript to assure its ability to com- 
municate Ci*e., complete thoughts ^ references that 
have meaning, appropriateness and inclusion of charts, 
etc.) . 

Current and future research in the area ^ A great deal of 
research has been done on ESS and S-AFA as separate programs. How- 
ever, the analysis of one program (in this case, ESS) in terms of 
the psychological bases of another (S-APA) is a relatively rare 
occurrence , 

Current social and economic conditions have daiopened interest 
in and support for science education* It would seem that there is 
merits however, in examining present science curricula in terms of 
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different theories of cognitive development.. Such ^ approach inigh 
reveal a great deal about the science programs and about cognitive 
development: as well* 
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Rav^n, Ronald J** '*The Development of the Concept of Acceleration in 
Elementary School children*'^ Journal of Research In Science 
Teaching . Vol* 9* No. 3:201-206, 1972. 

Descriptors — ^Cognitive I>evelopment> ^Concept Formation, 
^Conservation (Concept), Elementary School Science, ^Kinetics * 
^Learning Theories, Physical Sciences, Scientific Concepts 

Expanded Abstract and Analysis Prepared Especial^ I»S.E. ^y 
David H, Ost, California State College* Bakersfield. 



Purpose 

To ascertain the developmental relationships among the speed and 
the acceleration concepts described by Piaget, the investigators 
tested the hypotheses that: 

la> the i^robability of success was the same for each of 
seven tasks; or, 

lb, at least two of the tasks were different; and, 

2a, the true probability of success on the tasks was 
the same for each grade level; or» 

2b, at least two of the grade groups were different. 



Rationale 

Elementary school science curricula frequently include learning 
e^qierlences which deal with acceleration. Raven's position Is that 
insufficient attention is given the logical relationships of velocity, 
time, and distance. It is pointed out that Piaget used four stages 
to describe the development of these relationships. 

Stage I, the child sees acceleration only as a rapid chanf^e 
without consideration to a continual change In speed. 

Stage II, the child may have an Intuitive feel for accelera- 
tion but may not perceive the gradation from "slowest" to 
"fastest" (six years). 

Stage III, the child begins to correlate the distance-time 
relationships (7-8 years) and subsequently (9-10 years) 
can compare distances or times traveled between measured 
intervals * 

Stage IV, the child is able to compare the relationships 
between the increases Iri the distance between equal inter- 
vals of time and the increase iti speed over equal intervals 
of time Cll years) * 
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Raven concltides that tha child mtist have attained reversibility 
of centratlon of successive speed relationships as well as decentra~ 
tioT7 of distance-time relationships in order to deal appropriately 
vith acceleration* In addition the child must have acquired conser- 
vation of uniform speeds* This suggests that there are several 
aspects related to the acquisition of the concept of acceleratioa^ 
uot the least of which is the attainment of measurement operations 
and the achievement of conservation of time and speed* 



Research Design and Procedure 

different concept tasks are reported to have been admin- 
istered to a sample of 96 thirds fourth^ fifths and sixth grade 
children* The questions and responses were oral* An incorrect 
an^uer or an ina(tequate explanation of the answer were considered 
as not ^'passing" responses* The tasks vere administered in random 
order to each child to control for learning* The titles of the 
tasks were: 



1* Speed task: simultaneous-synchronous time with dif- 
ferent distances^ 

2* Speed task; sijccessive speeds travelling equal distances 
in unequal times; 

3* Speed task: conservation of unifom speed; 

4* Acceleration task: successive independent comparisons? 

5* Acceleration task: seriate speeds^ distance intervals 
equal; 

6* Acceleration task: seriat^ time^ distance intervals 
equal; and, 

7* Acceleration task: seriate distance, time intervals equal* 



Appropriate descriptions of the protocol utilised for each task are 
given in detail* 

The null hypothesis (la) was tested by applying the Cochran Q 
test* Twelve children at each grade level vere selected from the 96 
children participating in the study* The hypothesis of no difference 
(lb) was tested by the application of the post hoc comparison method 
described by Marascuila and McSweeney*^ 

To ascertain whether or not the probability for success was the 
same for each grade (hypothesis 2a) for the remaining 48 children in 
the sample p the Friedmar two-way analysis of variance was used* 



iMarasculia^ Leonard and Maryellen McSweeney, "Nonpar ame trie Post 

Hoc Comparison for Trend." Psychological Bulletin , 67:401-^12, 
1967* 
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The 22B^ hoc comparisons was again employed to determine the degree 
of difference between age groups (hypothesis 2b). 

A scalogram analysis was perfonoed on the seven tasks. 



Findings 

The data are easily summarised In Table I- All four null hypo- 
theses are rejected, 

A reproducibility coefficient of .86 for the seven tasks was 
found using the scalogram analysis. No other results of the analysis 
were teported. 



Table I 



Percent of Children Attaining a Positive Score = 96) 
Age (Years) 



Task 


1 


9^ 




11 


1 


SO 


93 


87 


93 


2 


7 


26 


67 


87 


3 


0 


20 


53 


80 


4 


67 


80 


87 


93 


5 


53 


7J 


93 


93 


6 


7 


13 


53 


73 


7 


0 


7 


40 


67 



In te rpr e tation s 

Raven provides a detailed <iiscussiou of the data and develops 
several interpretations and conclusions. The results are interpreted 
with great care to show that the speed and acceleration tasks that 
require intensive logical operations (comparison of the whole with a 
part) could be handled by third and fourth grade children. Tasks 
which employ extensive logical operations are appropriate for fifth 
and sixth grade children. Such operations involve the comparison of 
conceptual parts with another* thus allowing the child to compare 



^ Edwards* A. L^* Techniques of Attitude Scale Construction , 
New York; Appleton-Century^Crof ts* 1957, 
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speeds of movementy ia auccession* Appav'ently the conservation of 
speed task 3 occiirs ptior to the acquisition of the acceleration 
tasks 6 and 7* 

ABSTRACTOR'S ANALYSIS 

In general, the reported study appears to be tightly designed 
and carefully thought through. The interpretations drawn appear to 
be consistent with the data resulting froi;j the investigation as well 
as with related studies • The position, held by Piaget, that con- 
servation of time and speed is a prerequisite to being able to com- 
pare units of speed and time ^s associated with acceleration, seems 
tf> be solidly supported* 

The implications for science curriculum developers seem straight 
forward. Learning activities related to growth rates of plants or 
populations, evolution, changes In the speeds of wagons, cars or 
space missiles, as well as other physical phenomena related to 
acceleration, should be developed only after careful consideration 
is given to the development of the logical relationships of velocity, 
titne, and distance • This notion supports in part the hierarchal 
nature of learning a la Gagnl but more specifically gives credibility 
to Piaget's assertion that conservation is a necessary condition for 
all rational activity. The acquisition of extensive logical opera-- 
tions is preceded by, if not dependent on, the ability to carry uut 
intensive operations. 

The report seems to lack in details in two areas. First, 
alth'iugh the data presented are based upon the results of seven con^ 
cept tasks, the investigator writes that '^elght different concept 
tasks were administered to all of the childrerii" Nowhere in the 
discussion is It explained what happened to the eighth task and 
associated results* The reader can speculate that it was a fourth 
task related to speed and was found to be redundant. (Or perhaps 
it was an acceleration task that produced inconsistent data.) 

A second area where completeness is lacking Is In the absence 
OF information In the results section related to the scalogram 
analysis. Conclusions are discussed which are based upon this 
analysis but no data are provided other than the reproducibility 
coefficient of .86 provided In the discussion section. Interpre- 
tations seem to be drawn from this one figure without elaboration 
of the reasoning* 

It Is not completely clear to this abstractor how one demon- 
strates the developmental relationships of subconcepts to a more 
sophisticated concept without including significant biases. The 
development and selection of tasks seem to be obvious locations of 
blaseSi The assumption among the majority of Piagetlan studies, 
such as this one, seems to be that there Is intrinsic objectivity 
In the tasksi Is It not possible for researchers to select and 
employ tasks which by their very nature support the premise under 
investigation? Such research might provide evidence of relationship 
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but iioes not negate the possibility of Independence, Thus> although 
It could be concluded that the tasks which require logical operations 
are related* this does not provide any more than Indirect evidence 
that the concepts are Interdependent.. It would seem that the results 
of relationship type studies can be determined a priori > Could It 
not slinply be that the number of attributes a task Incorporates Is 
the basis for a difference of responses and not the relationship of 
those attributes? 

These comments are not directed specifically at the study 
reported by Raven*. In fact* his Interpretations are very conserva* 
tlve and couched In noncomml tal terms.. Nevertheless It would seem 
that some mechanism for randomly selecting tasks that reportedly 
evaluate specific cognitive stages or concepts could be employed to 
correct for problems associated with Internal validity. 
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Raven* Ronald J^^ "The Effects of a Structured Learning Sequence on 
Second and Third Grade Children's Classification Achievement*." 
Journal of Research in Science Teaching > Vol. 7^ No, 2:153-160, 
1970, 

*Acadeinic Achievement, ^Classification, ^Elementary School Science 
Evaluation, ^Instruction, Task Performance 

Expanded Abstract and Analysis Prepared Especially for I*.S*.E*. by 
Ann C, Kowe, Syracuse University*. 



Purpose 

The investigation was undertaken to determine whether the use of 
a set of instructional materials based on classification ruled would 
facilitate the acquisition of classification abilities by second end 
third grade children. 



Rationale 

The conceptual framework for the study was Piagetiati theory as 
it has been extended by the search for training methods which will 
promote the development of logical thinking. When knowledge of and 
interest in Piaget's work developed in this country many attempts 
were made to train childrer. to perform tasks of logical thinking. 
Hany of the early attempts used direct reinforced training methods 
and were c^otably unsuccessful. At the time this investigation was 
carried out, a few successful training experiments had been reported 
and investigators were turning to training procedures based on the 
presL ^d logical prerequisites for the task in question. Thus, in 
the present study, logical operations described by Piaget and Inhelder 
were rewritten as 12 classification rules and were then used as the 
basis for instruction and testing. Pictorial representation and verbal 
rules were used as the method of instrtjctioa because of promising 
results obtained by other investigators who had used similar techniques 
The study was grounded in theory and took into account recent work in 
the field. 



I>esign and Procedure 

1. Instructional Materials . Instructional materials consisted 
of exercise booklets which contained teaching frames followed by 
transfer frames. The upper part of each page (frame) contained a 
pictorial representation and a verbal expression of ^ classification 
rule; the lover half contained instructions and a problem to be solved. 
Teaching frames contained shaded and unshaded geometric shapes in two 
sizes; the transfer frames contained drawings of such familiar objects 
as plants and animals . 

The 12 classification rules were divided into five rules for 
simple grouping (rules 1-5) and seven rules for hierarchical classi- 
fication operatioa^ (rules 6--12) , 
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2* Testing Materials * Three items were written for each of the 
12 rules and presented in a format similar to that us«d for the 
instructional materials. The upper half of the page contained a 
solvt^d problem and the lower half presented the problem to be solved* 
No words were used on the test pages; instructions were given orally.. 
PresumablVt one point was scored for each item*. A reliability coef- 
ficient o£ *86 is reported* 

3* Sample ^ All the chlddren enrolled in the second and third 
grades of the public schools in a small city participated in the study* 
There were 210 second grade children and 175 third grade children 
from seven classes at each level* 

4^ De s ign ^ Children in each class were assigned at random to 
Group It Group 2^ or the Control Group*. This resulted in the forma- 
tion of six groupst three at each grade level* Achievement and I*Q* 
test scores are presented to show the equivalence of the three groups 
at each level * 

After assignment to groups^ all children worked in exercise 
booklets as part of the regular classroom schedule for 15 minutes per 
day for 24 days* Children in Group 1 received booklets containing 
instruction on all 12 rules; those in Group 2 received booklets con- 
taining instruction only on rules 6-12 but the total nximber of frames 
was the same* Children in the Control Group were given drawing and 
coloring activities* Classroom teachers supervised the work of the 
children * 

One or two days after the completion of the exercises the test 
was administered to all the children by persons other than the class- 
rooni teachers * 

The design of the experiment Included random assignment of sub- 
jects at each grade level to two treatment groups and one control 
group, followed by instruction and a posttest carried out as part of 
the regular classroom routine* 

5* Analysis of Data > The dependent variable was the score on 
the 36-item posttest. These data are presented as total mean score 
for each group and as subtest mean scores for each group* (The three 
test items for one classification rule make up a subtest*.) The group 
mean scores were subjected to multivariate analysis for treatment* 
grade» and class and were used to make planned comparisons of control 
vs* experimental groups and of Group 1 Vs* Group 2* The simple groups 
Ing subtest scores (items 1'5) and hlerarchial classification subtest 
scores (items 6-12) for each group were subjected to multivariate 
analysis of covarlance using first one (subtest scores 1-3) and then 
the other (subtest scores 6-12) as the covariate*. 



Findings 



The principal findings were as follows: 



1* Children in the experimental groups scored higher than 
those in the control groups on the posttest (p< ..01)* 



56 




ERLC 



2. Third graiJe children scored higher than second grade 
children on the posttest Cp< .01). 

3. Within grade levels, no significant class differences 
were found. 

4. The two experimental groups scored at the same level on 
the posttest. 

5. Tlie tvo experimental groups scored at the same level on 
subtest items 6-12 (hlerarchlal classification). 

6. Children in Group 2 scored higher than children in the 
Control Group on subtest item 1-5 (simple grouping) 
Cp<: .01). 



Xnterpretations 

The main conclusion was that the program of instruction did 
enhance the children*^ clas^iJification test performance* The tvo pro- 
cedures used in the study were equally ef f ective » both vith respect 
to total test performance and performance on subtests. Third grade 
children performed at a higher level than did second grade children, 
particularly on the hierarchical classification tasks. The results 
of the analysis of covariance, in which items 1-5 (simple grouping) 
and items 6-12 (hierarchical classification) were separated, were taken 
to mean that practice on the simple grouping tasks did not facilitate 
performance on the hierarchical tasks, but that practice on the 
hierarchical tasks retroactively facilitated performance on the simple 
grouping tasks * 

abstractor's analysis 

This investigation contributes to the continuing effort to trans- 
late Piagetian theory into classroom practice* Piaget described the 
course of the development of logical thinking but left it to others to 
make what practical use they could of his work* When psychologists 
and educators learned that children did not understand the concept of 
conservation, they set about to teach conservation* When their efforts 
did not have the desired results, conservation and the mental processes 
leading up to it took on the aura of a mystery; the idea that con- 
servation and, by implication, all other Piaget tasks, could not be 
taught became accepted as revealed truth* In the study which is being 
considered here the focus was not on a specific task but, instead, on 
the underlying logical operations. Growth in classification ability 
(i*e., logical thinking) was measured by an increase in test scores 
rather than by a shift in status from classifier to non-classifier. 
The approach adopted in this study takes away the mystery surrounding 
Piagetian theory and puts It into the practical world of the classroom 
teacher who is familiar with exercise books containing examples and 
problems to solved. 



In order for the results to be convincing we have to believe that 
the test measured only growth in classification ability and that the 
experimental groups did not have an advantage gained through famlli" 
arlty with the format of the test pages and practice in solving similar 
problems* There is no way for this to be determined and no mention is 
made of It in the article, but there is evidence from the subtest 
scores which Is somewhat reassuring on this point* If the Control 
Group scores were uniformly lower than the Group 1 or Group 2 scores^ 
this difference might be attributed to lack of familiarity with the 
test format, but, in fact, the difference between Control Group scores 
and experimental group scores varies from .04 to 1,89 (of a possible 
3*0)* SOj while the possibility of a reactive effect exists, it is 
unlikely that it was a significant factor. 

It is not clear how the multivariate analysis of covariance was 
used in comparing subtest scores of the experimental groups, Apparentlyf 
subtest scores for rules 1-5 were used as covariates for comparing 
subtest scores of rules 6-12^ and subtest scores of rules 6-12 were 
used as covariates for comparing subtest scores of rules 1-5, But all 
the subtest scores were presumably affected by the Instructional pro- 
gram andt therefore, could not be used as covariates in comparing 
treatment effects. The results of this analysis were interpreted as 
showing that practice on the more complex rules enhanced learning of 
the simpler rules and that practice on all the rules produced no higher 
test performance than practice on only the complex rules* The results 
of this analysis would carry more weight if the logic of the statistical 
procedure were made explicit. 

This Is one of a series of investigations in which materials pro- 
grammed to facilitate the acquisition of logical operations have been 
developed and subsequently tested in classrooms* The Implications of 
this investigation are best understood when viewed as part of a larger 
research project- 
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Allen, Leslie R. , '^An Evaluation of Certain Cognlcive Aspects of ttte 
Material Objects Unit of the Science Curriculum Improvement 
Study Elementary Science Program/' Journal of Research In Stlence 
Teaching . Vol. 7, No. 4:277-281, 1970. 

Descriptors — ^Achievement j *Curriculumt ^Elementary School 
Science^ ^Evaluations Grade I» Student Evaluation^ Student 
Behavior 

Expanded Abstract and Analysis Prepared Especially for I.S.E. by 
Chester E* Raun* Temple University. 



Purpose 

The investigator i(3entifles the purpose of this study as an 
effort to determine whether those first grade students who partici- 
pated In the SCIS unit "Material Objects" demonstrated a performance* 
on certain SCIS objectives » at a level superior to first grade students 
who were non-partlctpants in the SCIS program. No specific testable 
hypotheses related to cognitive aspects are stated. 



Rationale 

"Material Objects" Is described as a unit which teaches the first 
grade child the fundamental concepts of (a) objects and their proper- 
ties and (b) material. It Is Indicated that the study is part of a 
larger study involving two other elementary science programs and 
extending, eventually » through grade six. The Investigator makes the 
statement that "this and subsequent studies will produce Information 
that can be used in making curricular decisions*" Previous research, 
identified by the investigator, to which this study may be related 
was carried out on the "Material Objects" unit by Hagen (9), and 
Haan (6), with Allen (1) Investigating classification skills of SCIS 
children at grades two, three, and six. 



Research Design and Procedure 

The investigator indicated that It was Impossible to carry out 
randomization of subjects Into groups, treatments to groups, and 
teachers to treatments because classes to be selected for study were 
already in existence. Therefore, the Static Group Comparison Design, 
as described by Campbell and Stanley (7)t was selected for use. Read- 
ing level, socioeconomic status, sex, and type of science program were 
Identified as the Independent variables while six selected objectives 
from the "Material Objects'* unit became the dependent variables. The 
six objective selected and the procedures for measurement were: 

1* To describe an object by its properties: The child was 

given a soda cracker and asked to state as many properties 
of the object as possible without any Imposed time limit* 



59 

63 



2, To group objects by material; A collection of objects, 
each made of a single material (rubber^ glass* plastic, 
metal, wood, paper, cloth) was placed before the child» 
The child was asked to group the objects by material 
and state why. 

3, To order objects serially by a stated property; The child 
was prei^ented with a random arrangement of blocks of 
wood of different lengths, thicknesses, and widths, to 
one side of which was glu&d sandpaper of different tax- 
tures and colors. The child was asked to arrange the 
blocks in order in as many way» as possible and to statfi 
reasons * 

4, Simple inference; The child was presented with a paper 
clip, a plastic button, a magnet, and an eraser, and 
asked to play with them^p A closed matchbox (containing 

a paper clip) was added to the set and the child was told 
that another one of the objects from the set was inside 
the box* The child was asked to name the hidden object 
and give his reason. 

5* To group objects by other than visual means: This item 
was designed to measure grouping performance when visual 
clues were absent. Because the tuatchboxos used were 
visually identical, the children were forced to group 
using criteria such as weight of the boxes and whether 
or not the contents rattled^, 

6t To group objects by visual means (Resemblance Sorting): 
The child was presented with 35 drawings of geometric and 
non-geometric shapes which could be matched by size, shape, 
pattern, or by each combination of these attributes^p 

The first five of the criterion measures were administered 
individually while the last was a group test. All test items were 
scored on the basis of one point for each acceptable response^ 

Among the independent variables only the type of science program 
is clearly delineated, i*e,, "SCIS" or texts such as "Concepts in 
Science." The variable of sex does not indicate how many girls or 
boys were involved in the experimental or control groups nor is the 
variable of reading level delineated as to ability level, source and 
means of assessing. The variable of socioeconomic status is only 
indicated as upper-average- lower without specific parameters or 
definitions of each level* 

The study was conducted during the 1968-69 school ye.ir at the 
University of Hawaii utilizing first grade children in the Honolulu 
schools* From those schools participating in the SCIS program (7 
schools, 21 classrooms) a random sample of 50 subjects was drawn for 
each of the three socioeconotjic levels for a total of 150 children 
in the experimental group. With I*Q* 's unavailable for first grade 
children, each of the SCIS schools was matched by a non-*SCIS school 
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of comparable soclo£^conomlc status* The above selection procedure 
was repeated for non-SClS children resulting in 150 children in the 
control group* It wafi indicated that a majority of the 300 subjects 
were of Oriental and Polynesian ancestry with a minority of Caucasians 
but no racial percentages are reported* 

The exact duration of the study or the exact time of conducting 
the study is not clear though the investigator does indicate that the 
control group "had spent a year with conventional* hard-cover, com- 
mercial eleinentary school science texts such as *Conceptii in Science**** 
This would lead the reader to assume that both groups had received 
equal treatment over time and that Che study was conducted either at 
the end of grade one or at the beginning of grade two^. 

Data collected by use of the criterion measures were summariced 
in a separate table for each criterion measure, indicating the total 
number of acceptable responses and the mean for each grovp (experi- 
mental and control) and for each socioeconomic status level* Each 
table was then analyzed by the parametric technique of multiple 
regression* Although not specifically stated in the narrative it 
appears, from a review of the summary table of multiple regression 
analysis, that a probability level of less than 0*10 was considered 
significantnp 



Findings 

For the sample of this study the results for criterion test 
it^s 1, 3, 5, and 6 indicate that the 5CX5 group produced a greater 
number of acceptable responses than did the non-SCIS groups. For 
criterion test item 2 the non-SCIS group accumulated a greater number 
of errors in sorting and had a greater number of objects not* grouped 
by material than did the 5CI5 group* 

A summary of multiple regression analysis for the criterion test 
items I, 2, 3, 3, aad 6 produced several F valttes with a low proba- 
bility that the results were attributable to chance^p Similar F values 
were also reported for items 1 and 5 with regard to the variable of 
science program; for items 2 and 6 with regard to the variables of 
socioeconomic status and reading; and for Item 3 with regard to the 
variables of socioeconomic status, reading, and science program* The 
variable of sex produced no significant effect* 

A more fundamental question of interest to the investigator, 
i,e,, "What percentage of the total variance is explained by the full 
equation and for which items is this explained variance statistically 
significant?" found another table showing the and R values for the 
full equation, and the R^ values for the restricted equations, (R^ 
^ the amount of predicted variance; R = the relationship between 
variables). The findings from this analysis indicated the relation- 
ship between variables to be statistically significant in items 1, 2, 
3, and 6, but only in items 3 (Serial Ordering) and 6 (desemblance 
Sorting) did the amount of explained variance exceed 10 percent. Of 
the latter items, only item 3 involved a significant decrease in pre- 
dictive power when the 5CIS program was omitted. 
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Criterion test Itism A (Simple Infererce) produced a negligible 
number of successful solutions (1 SCiS and 3 non-SCIS) and was not 
Included tn the analysis. 



Interpretation 

It is concluded^ as a result of the study^ that first grade SCIS 
children are superior to non-SCIS children only in their ability to 
serially order objects. As a result of chi-square calculations It was 
further concluded that in four out of the five test items in which 
objects were presented for examination and manipulation (Items 1^ 2, 
3j and 4) the SCIS children exhibited significantly more exploratory 
behavior than did non-SCIS children. In general it appears that dif- 
ferences are minimal with respect to successful item responses. The 
investigator suggests that superior ejq>loratory behavior may be all 
that can realistically be expected after only one year of exposure to 
this (SCIS) program. He further suggests that should annual incre- 
ments of change occur^ and If these changes are additive^ there may 
be a cumulative effect of the program measureable at grade six> 

ABSTRACTOR'S ANALYSIS 

The*"^ have been^ in tecent years^ numerous coniparative studies 
between t. e "newer" elementary science currlculums^ e»g-j ESS^ SAPA^ 
and SClSj and the more conventional* textbook-centered science cur- 
ricuiums - A limited number of these have been research studies con- 
cerning the child's cognitive development as a result of the treat- 
ment effects of the "newer" currlculums. This number is further 
reduced if one considers only those related to the SCIS program. 

In addition to the studies cited by the investigator » one finds 
that Thler (17) itives tlgated first graders' understanding of the con- 
cept of matter using the "Material Objects" unit for the specific 
purpose of revising the unit when lack of understanding was identi- 
fied as being significant. Raven (15) used SCIS as a vehicle to 
investigate concept development. The purpose of the study was to 
determine the developmental sequence necessary for understanding 
momentum. The results supported Plaget's findings that children 
understand concepts about matter before they understand concepts 
about speed , 

Stafford and Renner (16) studied the effect of instruction^ based 
on the "Material Objects" unit^ in accelerating concept skills attain- 
ment in the area of conservation- The esqierimental group of first 
grade children showed a greater growth in each of the six conservation 
areas ti,<s ted (i,et^ conservation of number^ length* liquid amount* 
solid amount^ weight, and area) > Conflicting results are reported 
by Neuman (14) when exploring the effect of instruction In selected 
experiences^ taken from the "Material Objects" unit^ on first grade 
pupils attainment of conservation of weight and quantity* Following 
18 weeks of instruction no differences were observed between the 
experimental and control groups* on pretest and posttest scores* as 
measured by adapted Piagetian conservation tasks. 
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Weber (18) conducted a study to determine the level to which SCIS 
develops the learner's ability to use selected science processes. 
Experimental and control groups of fifth grade pupils were compared 
regarding their performance on a series of science process-oriented 
tasks. The results showed the SCIS group to be clearly superior in 
regard to each of the six processes studied (l>-^'t observation^ classi- 
ficatlorjt measureraentt experimentationt interpretatlont and prediction). 
It was also noted that SCIS pupils were more aggressive In their 
approach to problems and were more diverse^ persistent^ and creative 
in their experimental designs. The aggressiveness of the fifth grade 
pupils would appear to be consistent with the superior exploratory 
behavior for first grade pupils reported by Allen, 

Considering the influence of science on other academic areas 
Kellogg (10) explored the effect of Instruction in the "Material 
Objects" unit on reading readiness of first grade pupils. Thirty- 
two pupils in the control group experienced a connnercial reading readi- 
ness program^ while thirty-seven pupils in the experimental group used 
the '^Material Objects" unit Instead of a reading readiness program. 
Both groups were pre- and posttested on the Metropolitan Heading Read- 
iness Test with an intervening treatment period of six weeks. Students 
in the experimental group showed greater *gains in five of the six sub- 
test areas. It was concluded that to best teach reading^ first teach 
thinking^ as represented by^ conservation reasoning. 

Other studies have been concerned with investigating teacher 
oehavior and the SCIS program, Wilson (19) discovered that SCIS 
teachers used a significantly higher level of questioning than non- 
SCIS teachers. This finding was also supported in independent inves- 
tigations by Bruce (6) and Moon (12), A conflicting report by^ 
Moriber (13) indicates that SC15 teachers were consistently^ asking 
lover order^ stimulus-response ty^pe of questions despite summer pro- 
gram preparation. The latter study raises serious questions about 
what is taught and how it is taught in teacher preparation programs 
as well as what actually occurs when teachers teach the program in 
the classroom, 

Kondo (11) focused on an analysis of the relationship between 
questioning behavior of the teacher and types of SCIS lessons (i,e, » 
exploration^ invention) as found in the "Material Objects" unit. 
The results indicated that the way a lesson Is approached (i,e,» 
teacher detoonstration^ children manipulating materials) has a greater 
influence on the type of question the teacher asks than the type of 
lesson , 

Though there appears to be a dearth of very recent studies 
reporting on the impact of the SCIS prograiu^ all of the above studies 
have direct or indirect relationship to the present study. However^ 
in all of the studies it is difficulty if not impossible^ to synthe- 
size results because extensive and detailed information is not pro- 
vided about the actual approaches being compared, A coniparative 
study without such information lacks external validity. The present 
study is no exception. 
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The reader IB Icfc to assume that all of the experimental group 
received equal treatnient*. Wliat evidence might have been presented 
v/hich would insure equal treatment? What evidence exists that insures 
adequate teacher preparation and presentation foj equal treatment? 
At what specific point in time was testing conducted? What, precisely, 
was different in treatment for the experimental and control groups? 
Answers to such questions, though requiring additional Input, could be 
presented in a concise manner and would begin to provide some of the 
information necessary to establishing external validity.. 

The investigator refers to ''certain cognitive aspects" in the 
title of the report but does not clearly delineate these cognitive 
aspects in the stated design of the study* The reader must assume 
that these are the selected objectives from the "Material Objects" 
ui^it. It would appear that these are reducible to the process skills 
of classifying and Inferring since they involve ordering, describing, 
and comparing. The question however remains. Are these the cognitive 
aspects the investigator refers to? In a siinilar vein, how does the 
investigator establish the parameters of socioeconomic status and what 
are these parameters? How many children were in each of the socio^ 
economic levels? Were boys and girls equally distributed In each 
level? 

Although It was apparently not the Intent of the investigator 
to analyze data other than that relevant to the avowed purpose oE the 
study, there are considerable data presented, particularly regarding 
the variables of socioeconomic status and reading, which are not 
addressed Jn interpretations*. Conversely, there is reference to chl- 
square calculations In the conclusions which are not addressed in 
discussion of analysis or findings. It seems appropriate to make 
reference to all reported findings, if only to indicate interpretations 
at a later date and certainly to substantiate all conclusions with 
necessary findings 

Though It is relatively easy to assume the role of the armchair 
tactician, it Is felt that attention to details, such as those raised 
by the comments and questions above, would strengthen this, and other 
studies, enhancing in turn their contribution to the science education 
literature. 

Coupled vith this is a need for improvement in comparative studies. 
Most such studies, as Indicated earlier » have considerable potential 
for improvement in terms of descriptive information regarding treat- 
ment variables. Anderson (5) has appropriately discussed the need for 
such information. The need for descriptive Information is not for 
statistical purposes but to fully describe what is being compared. 
Despite Impressive statistical data unless one knows what is being 
compared, knowledge about which approach is better is of little value.. 

Aside Erom the need for descriptive information there is also a 
need for studies which follow through on a given population over a 
period of years. It la refreshing to note that Allen has not only 
indicated a series of studies would be conducted with the same popu- 
lation over a period of time but has actually reported subsequent 
studies (2, 3, 4). The concept of longitudinal studies is not new 
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but such studies are executed though they are desperately needed 
to establish the worth and continued use of any curriculum and/or 
methodology. It is doubtfulj howevetj that this study and others have 
produced results which "can be used in making curricular decisions." 
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